-- Logs begin at Thu 2022-10-27 08:57:46 UTC, end at Thu 2022-10-27 09:55:57 UTC. -- Oct 27 09:28:01.907082 dv-cinder-797970-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 09:28:01.915834 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 09:28:01.917829 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 09:28:01 2022] *** Oct 27 09:28:01.917829 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 09:28:01.917829 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 09:28:01.917829 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: nodename: dv-cinder-797970-7-iscsi Oct 27 09:28:01.917829 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: machine: x86_64 Oct 27 09:28:01.917829 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: clock source: unix Oct 27 09:28:01.917829 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: pcre jit disabled Oct 27 09:28:01.917829 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: detected number of CPU cores: 4 Oct 27 09:28:01.917829 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: current working directory: / Oct 27 09:28:01.917829 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: detected binary path: /usr/bin/uwsgi-core Oct 27 09:28:01.918564 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: your processes number limit is 47680 Oct 27 09:28:01.918564 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: your memory page size is 4096 bytes Oct 27 09:28:01.918564 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: detected max file descriptor number: 2048 Oct 27 09:28:01.918564 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: lock engine: pthread robust mutexes Oct 27 09:28:01.918564 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: thunder lock: enabled Oct 27 09:28:01.918564 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 09:28:01.918564 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 09:28:01.958563 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: Python main interpreter initialized at 0x56411b2bd9c0 Oct 27 09:28:01.958563 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: python threads support enabled Oct 27 09:28:01.958563 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: your server socket listen backlog is limited to 100 connections Oct 27 09:28:01.958563 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: your mercy for graceful operations on workers is 90 seconds Oct 27 09:28:01.958894 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 09:28:01.958974 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: *** Operational MODE: preforking *** Oct 27 09:28:01.959213 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: *** uWSGI is running in multiple interpreter mode *** Oct 27 09:28:01.959213 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: spawned uWSGI master process (pid: 103906) Oct 27 09:28:01.959394 dv-cinder-797970-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 09:28:01.961011 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: spawned uWSGI worker 1 (pid: 103907, cores: 1) Oct 27 09:28:01.961011 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: spawned uWSGI worker 2 (pid: 103908, cores: 1) Oct 27 09:28:01.961011 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 09:28:02.615208 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 09:28:02.618105 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 09:28:03.681229 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:28:03.681229 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: from cryptography.utils import int_from_bytes Oct 27 09:28:03.681814 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:28:03.681814 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: from cryptography.utils import int_from_bytes Oct 27 09:28:03.684251 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:28:03.684251 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: from cryptography.utils import int_from_bytes Oct 27 09:28:03.684720 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:28:03.684720 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: from cryptography.utils import int_from_bytes Oct 27 09:28:06.152499 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 09:28:06.153097 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 09:28:06.153275 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 09:28:06.153629 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 09:28:06.153880 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 09:28:06.154807 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.155129 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.155445 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.155764 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.156088 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.156392 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.156734 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.157046 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.157366 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.157621 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.157819 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 09:28:06.158198 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.158292 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 09:28:06.158380 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-7-iscsi {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.158537 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.158624 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 09:28:06.158839 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.158936 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 09:28:06.159144 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.159238 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 09:28:06.159453 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.159546 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.159752 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.159847 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.160069 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.160157 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.160369 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.160465 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.160814 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.160903 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.161306 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.161447 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.161578 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.161706 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.161816 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.161924 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.162032 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.162226 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.162371 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.162514 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.162641 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.162820 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.162957 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-7-iscsi {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.163133 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.163268 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.163439 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.163582 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.163757 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.163894 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.164060 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.164200 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.164382 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.164511 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-7-iscsi {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.164732 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.164872 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.165043 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.165174 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.165350 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.165552 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.165763 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.165901 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.166071 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.166203 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.166375 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.166504 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.166692 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.166832 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.167009 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.167139 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.167309 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.167439 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.167629 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.167760 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.167943 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.168088 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.168256 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.168388 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.168584 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.168715 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.168881 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.169012 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-7-iscsi {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.169184 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.169323 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.169487 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.169635 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.169901 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.170031 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.170218 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.170348 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.170518 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.170657 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.170783 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.170919 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.171045 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.171208 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.171355 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.171532 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.171673 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.171840 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.171971 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.172167 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.172320 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.172554 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.172701 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.172831 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.172957 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.173089 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.173227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.173354 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.173482 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.173620 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.173750 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.173960 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.174106 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.174235 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.174383 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.174537 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.174691 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.174831 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.174997 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.175136 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.175270 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.175397 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.175523 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.175728 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.175897 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.176024 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.176150 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.176322 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.176454 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.176648 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.176789 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.176965 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.177096 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.177281 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.177494 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.177637 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.177765 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.177898 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.178026 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.178190 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.178335 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.178492 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.178632 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.178792 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.178921 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.179100 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.179245 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.179409 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.179547 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.179723 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.179856 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.179997 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.180134 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.180294 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.180424 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.180630 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.180770 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.180952 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.181089 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.181249 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.181387 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.181514 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.181640 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.181779 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.181947 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.182077 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.182210 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.182347 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.182474 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.182697 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.182829 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.182957 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.183122 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.183254 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.183431 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.183562 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.183750 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.183892 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.184057 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.184191 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.184357 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.184489 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.184696 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.184825 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.184952 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.185079 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.185273 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.185411 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.185577 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.185708 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.185885 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.186025 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.186163 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.186297 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.186423 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.186549 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.186727 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.186868 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.187047 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.187187 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.187350 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.187479 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.187651 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.187795 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.187937 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.188075 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.188237 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.188368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.188567 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.188699 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.188870 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.189001 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.189170 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.189301 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.189473 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.189611 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.189772 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.189909 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.190071 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.190202 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.190371 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.190509 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.190671 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.190800 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.190972 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.191103 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.191273 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.191416 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.191568 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.191697 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.191870 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.192001 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.192182 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.192321 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.192482 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.192665 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.192881 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.193016 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.193143 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.193278 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.193406 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.193530 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.193661 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.193806 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.193934 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.194069 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.194226 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.194357 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.194521 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.194652 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.194813 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.194945 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.195123 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.195261 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.195435 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.195567 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.195738 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.195870 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.196043 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.196174 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.196339 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.196468 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.196670 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.196809 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.196988 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.197120 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.197293 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.197519 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.197661 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.197797 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.197924 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.198050 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.198176 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.198315 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.198466 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.198597 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.198769 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.198900 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.199070 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.199210 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.199370 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.199502 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.199670 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.199802 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.199988 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.200128 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.200308 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.200439 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.200631 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.200762 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.201458 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.201602 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.201766 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.201897 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.202086 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.202215 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:28:06.202401 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.202532 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.202712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.202859 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.203063 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.203200 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.203336 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.203452 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.203612 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.203743 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.203935 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.204088 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.204251 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.204382 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.204576 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.204739 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.204926 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.205058 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.205236 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.205449 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.205586 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.205713 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.205846 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.205974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.206136 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.206268 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.206442 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.206571 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.206746 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.206886 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.207050 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.207182 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.207374 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.207503 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.207680 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.207822 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.207987 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.208126 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.208299 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.208437 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.208626 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.208771 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.208945 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.209075 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.209251 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.209382 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.209555 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.209695 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.209860 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.209998 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.210165 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.210298 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.210469 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.210609 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.210795 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.210927 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.211104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.211236 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.211419 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.211549 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.211724 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.211853 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.212032 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.212163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.212338 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.212468 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.212664 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.212809 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.212970 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.213181 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.213323 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.213451 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.213567 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.213700 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.213827 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.213953 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.214127 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.214259 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.214429 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.214561 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.214729 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.214869 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.215042 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.215174 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.215366 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.215747 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.215929 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.216068 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.216248 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.216384 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.216623 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.217264 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.217437 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.217589 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.217743 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.217874 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.218050 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.218182 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.218352 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.218493 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.218658 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.218789 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.218964 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.219102 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.219265 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.219413 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.219569 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.219700 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.219873 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.220002 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.220173 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.220304 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.220474 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.220687 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.220893 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.221024 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.221160 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.221288 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.221414 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.221540 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.221666 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.221793 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.221959 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.222090 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.222268 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.222399 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.222574 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.222714 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.222894 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.223025 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.223205 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.223341 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.223513 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.223643 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.223825 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.223943 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.224131 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.224229 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.224435 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.224593 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.224776 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.224882 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.225078 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.225164 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.225391 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.225496 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.225692 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.225778 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.225999 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.226085 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.226299 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.226395 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.226600 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.226688 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.226901 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.226996 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.227205 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.227302 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.227503 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.227591 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.227804 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.227891 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.228103 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.228193 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.228402 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.228490 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.228726 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.228829 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.229045 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.229146 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.229347 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.229443 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.229645 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.229742 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.229943 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.230031 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.230240 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.230327 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.230578 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.230674 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.230880 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.230968 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.231182 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.231269 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.231488 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.231585 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.231794 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.231882 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.232862 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.232966 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.233049 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.233148 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.233232 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.233311 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.233528 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.233617 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.233834 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.233923 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.234136 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.234242 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.234441 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.234530 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.234750 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.234838 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.235050 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.235144 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.235354 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.235442 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.235654 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.235753 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.235978 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.236067 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.236284 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.236372 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.236620 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.236724 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.236921 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.237010 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.237232 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.237319 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.237568 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.237657 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.237877 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.237964 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.238193 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.238294 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.238501 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.238598 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.238804 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.238899 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.239114 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.239291 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.239442 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.239598 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.239750 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.239894 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.240036 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.240186 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.240335 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.240477 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.240658 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.240802 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.240954 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.241106 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.241248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.241389 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.241540 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.241683 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.241834 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.241976 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.242117 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.242258 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.242399 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.242540 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.242691 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.242834 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.242976 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.243117 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.243280 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.243440 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.243667 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.243853 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.244001 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.244171 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.244322 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.244473 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.244652 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.244806 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.244955 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.245097 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.245238 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.245397 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.245549 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.245750 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.245955 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.246102 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.246251 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.246402 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.246554 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.246696 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.246845 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.246998 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.247141 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.247292 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.247446 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.247586 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.247735 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.248422 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.248597 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.248758 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.248901 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.249056 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.249198 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.249198 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.249464 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.249615 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.249757 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.249909 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.250052 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.250233 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.250393 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.250535 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.250683 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.250831 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.250972 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.251115 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.251265 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.251416 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.251557 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.251698 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.251856 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.252005 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.252158 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.252300 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.252448 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.252618 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.252760 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.252900 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.253054 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.253198 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.253339 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.253506 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.253697 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.253928 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.254076 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.254226 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.254376 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.254517 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.254665 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.254858 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.255001 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.255142 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.255283 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.255435 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.255578 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.255740 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.255882 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.256023 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.256164 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.256305 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.256453 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.256697 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.256843 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.256984 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.257125 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.257273 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.257426 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.257568 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.257720 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.257861 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.258002 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.258142 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.258296 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.258440 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.258582 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.258723 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.258864 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.259004 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.259154 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.259296 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.259437 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.259589 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.259729 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.259880 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.260035 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.260035 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.260310 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.260453 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.260644 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.260797 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.260938 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.261087 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.261228 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.261378 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.261518 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.261675 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.261883 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.262040 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.262182 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.262323 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.262464 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.262606 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.262756 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.262899 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.263039 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.263180 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.263331 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.263505 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.263656 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.263799 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.264026 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.264175 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.264331 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.264422 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.264548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.264634 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.264715 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.264794 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.264872 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.264951 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.265156 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.265249 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.265495 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.265593 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.265796 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.265895 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.266097 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.266200 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.266406 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.266496 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.266706 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.266805 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.267012 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.267103 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.267310 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.267398 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.267633 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.267796 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.267951 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.268094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.268247 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.268398 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.268569 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.268734 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.268900 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.269044 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.269185 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.269327 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.269468 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.269608 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.269759 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.269903 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.270044 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.270195 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.270380 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.270536 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.270678 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.270827 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.270980 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.271124 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.271273 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.271423 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.271565 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.271705 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.271846 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.271985 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.272137 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.272288 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.272431 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.272593 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.272761 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.272904 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.273044 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.273196 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.273345 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.273486 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.273626 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.273766 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.273916 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.274157 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.274308 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.274450 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.274601 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.274743 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.274897 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.275039 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.275182 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.275324 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.275474 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.275615 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.275765 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.275953 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.276114 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.276258 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.276408 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.276611 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.276776 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.276925 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.277074 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.277222 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.277372 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.277522 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.277664 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.277804 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.277951 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.278106 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.278248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.278248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.278536 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.278686 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.278827 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.278990 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.279140 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.279359 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.279505 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.279647 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.279788 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.279928 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.280076 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.280228 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.280370 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.280542 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.280690 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.280842 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.280993 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.281154 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.281297 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.281438 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.281580 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.281721 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.281871 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.282014 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.282154 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.282302 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.282455 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.282606 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.282757 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.282899 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.283039 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.283180 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.283321 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.283462 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.284183 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.284404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.284577 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.284727 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.284894 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.285038 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.285179 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.285320 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.285460 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.285601 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.285752 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.285901 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.286043 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.286183 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.286325 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.286465 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.286639 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.286784 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.286924 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.287064 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.287205 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.287353 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.287504 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.287646 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.287799 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.287941 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.288082 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.288232 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.288374 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.288548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.288704 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.288847 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.288988 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.289147 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.289289 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.289584 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.289734 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.289878 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.290019 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.290170 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.290313 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.290461 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.290614 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.290756 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.290897 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.291048 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.291190 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.291331 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.291472 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.291614 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.291762 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.291913 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.292055 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.292196 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.292337 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.292491 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.292669 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.292814 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.292955 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.293097 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.293238 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.293387 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.293538 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.293680 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.293828 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.293969 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.294112 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.294252 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.294430 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.294579 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.295237 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.295380 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.295521 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.295663 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.295817 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.295959 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.296100 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.296244 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.296385 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.296554 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.296713 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.296856 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.296997 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.297138 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.297138 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.297423 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.297573 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.297715 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.297864 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.298005 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.298146 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.298298 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.298440 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.298599 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.298748 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.298896 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.299056 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.299212 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.299356 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.299497 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.299671 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.299817 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.299968 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.300110 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.300251 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.300393 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.300591 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.300739 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.300893 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.301042 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.301184 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.301325 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.301468 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.301610 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.301760 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.301910 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.302051 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.302192 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.302333 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.302485 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.302641 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.302783 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.302930 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.303078 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.303226 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.303383 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.303535 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.303683 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.303832 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.303980 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.304127 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.304294 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.304294 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.304597 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.304749 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.304897 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.305044 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.305204 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.305353 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.305500 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.305500 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.305782 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.305930 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.306090 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.306249 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.306397 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.306543 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.306692 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.306848 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.306997 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.307145 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.307292 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.307440 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.307588 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.307813 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.307964 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.308112 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.308270 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.308418 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.308628 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.308802 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.308953 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.309109 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.309257 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.309404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.309552 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.309552 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.309843 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.309993 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.310158 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.310359 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.311016 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.311016 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.311315 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.311462 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.311604 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.311746 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.311899 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.312042 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.312191 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.312333 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.312473 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.312655 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.312811 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.312955 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.313096 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.313235 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.313375 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.313525 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.313677 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.313818 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.313985 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.314148 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.314290 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.314431 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.314584 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.314727 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.314877 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.315021 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.315161 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.315302 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.315442 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.315596 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.315739 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.315886 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.316043 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.316200 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.316348 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.316537 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.316695 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.316843 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.316990 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.317138 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.317296 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.317453 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.317602 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.317759 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.317915 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.318064 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.318213 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.318448 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.318598 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.318753 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.318902 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.319056 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.319218 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.319368 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.319522 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.319671 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.319818 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.319972 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.320130 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.320281 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.320440 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.320641 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.320641 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.320925 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.321086 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.321236 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.321392 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.321541 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.321689 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.321836 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.321993 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.322141 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.322290 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.322449 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.322597 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.322758 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.322907 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.323055 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.323209 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.323358 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.323507 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.323663 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.323812 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.323960 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.324107 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.324262 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.324421 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.324604 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.324760 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.324908 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.325063 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.325212 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.325360 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.325522 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.325672 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.325820 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.325995 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.326154 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.326326 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.326475 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.326625 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.326773 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.326921 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.327068 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.327225 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.327373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.327520 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.327670 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.327818 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.327972 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.328129 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.328295 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.328444 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.328647 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.328799 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.328957 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.329126 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.329276 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.329424 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.329571 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.329720 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.329882 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.330030 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.330188 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.330348 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.330497 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.330665 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.330824 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.330975 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.330975 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.331264 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.331413 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.331560 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.331717 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.331867 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.332015 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.332162 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.332320 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.332475 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.332667 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.332826 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.332976 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.333125 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.333273 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.333430 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.333579 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.333733 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.333882 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.334030 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.334197 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.334316 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.334416 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.334503 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.334586 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.334682 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.334784 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.334881 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.334981 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335070 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335159 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335239 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335318 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335406 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335487 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335566 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335652 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335740 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335829 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335911 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.335990 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.336081 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.336162 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.336240 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.336327 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.336408 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.336576 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.336741 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.336892 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.337296 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.337466 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.337629 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.337778 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.337934 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.338083 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.338240 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.338399 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.338548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.338707 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.338864 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.339020 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.339179 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.339329 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.339484 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.339642 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.339790 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.339938 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.340105 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.340257 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.340406 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.340827 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.340991 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.341141 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.341303 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.341454 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.341630 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.341779 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.341927 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.342092 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.342242 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.342392 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.342540 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.342689 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.342848 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.343005 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.343154 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.343315 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.343465 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.343613 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.343761 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.343761 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.344053 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.344201 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.344349 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.344558 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.344740 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.344915 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.345069 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.345218 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.345373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.345524 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.345768 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.345968 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.346121 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.346271 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.346426 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.346589 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.346753 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.346921 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.347071 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.347227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.347417 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.347583 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.347732 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.347880 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.348028 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.348183 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.348338 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.348501 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.348501 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.348833 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.348984 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.349132 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.349132 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.349422 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.349579 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.349729 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.349884 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.350040 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.350201 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.350412 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.350569 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.350731 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.350888 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.351040 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.351200 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.351350 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.351497 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.351652 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.351802 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.351959 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.352108 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.352255 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.352403 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.352590 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.352745 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.352912 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.353071 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.353220 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.353368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.353516 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.353664 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.353826 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.353977 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.354126 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.354274 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.354422 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.354587 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.354782 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.354949 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.355100 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.355249 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.355249 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.355540 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.355690 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.355845 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.355995 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.356145 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.356145 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.356445 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.356636 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.356787 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.356948 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.357624 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.357781 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.357939 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.358090 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.358239 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.358394 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.358544 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.358699 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.358858 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.359017 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.359017 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.359300 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.359448 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.359606 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.359754 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.359902 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.360061 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.360211 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.360359 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.360538 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.360697 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.360846 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.361005 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.361153 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.361303 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.361463 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.361613 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.361761 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.361909 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.362058 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.362207 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.362365 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.362513 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.362513 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.362794 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.362958 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.363116 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.363266 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.363414 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.363562 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.363710 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.363858 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.364015 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.364164 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.364313 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.364462 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.364686 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.364858 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.365021 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.365171 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.365319 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.365468 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.365617 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.365765 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.365922 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.366070 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.366225 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.366373 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.366522 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.366683 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.366845 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.367008 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.367158 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.367306 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.367455 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.367612 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.367761 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.367909 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.368057 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.368205 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.368352 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.368538 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.368696 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.368856 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.369004 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.369153 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.369301 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.369301 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.369598 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.369748 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.369902 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.370060 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.370218 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.370367 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.370515 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.370665 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.370830 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.370986 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.371143 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.371293 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.371440 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.371595 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.371746 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.371895 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.372056 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.372205 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.372352 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.372501 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.372688 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.373374 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.373539 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.373690 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.373846 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.373995 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.374144 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.374301 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.374451 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.374606 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.374756 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.374913 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.375062 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.375297 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.375448 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.375597 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.375745 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.375745 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.376048 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.376210 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.376360 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.376507 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.376704 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.376852 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.377014 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.377174 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.377323 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.377471 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.377619 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.377767 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.377767 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.378071 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.378232 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.378381 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.378529 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.378677 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.378835 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.378985 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.379151 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.379300 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.379447 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.379595 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.379752 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.379903 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.380074 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.380225 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.380374 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.380560 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.380717 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.380866 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.381026 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.381175 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.381175 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.381472 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.381622 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.381770 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.381918 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.382066 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.382215 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.382373 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.382522 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.382669 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.382817 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.382975 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.383137 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.383137 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.383428 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.383578 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.383726 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.383873 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.384031 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.384180 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.384329 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.384478 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.384651 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.384812 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.384977 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.385129 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.385279 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.385433 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.385582 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.385747 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.385897 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.385897 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.386178 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.386327 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.386482 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.386640 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.386800 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.386948 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.387096 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.387244 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.387394 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.387552 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.387702 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.387849 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.387997 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.388147 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.388303 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.388482 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.388667 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.388817 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.388817 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.389098 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.389259 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.389408 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.389557 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.389705 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.389853 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.390007 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.390168 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.390316 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.390475 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.390475 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.390783 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.390933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.391090 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.391247 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.391396 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.391544 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.391694 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.391851 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.392000 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.392148 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.392296 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.392466 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.392680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.392849 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.392999 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.393148 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.393295 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.393444 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.393593 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.393755 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.393906 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.394055 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.394203 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.394352 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.394519 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.394703 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.394810 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.394897 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.394979 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395059 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395154 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395262 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395344 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395424 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395503 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395583 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395675 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395757 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395836 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395915 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.395994 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.396082 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.396171 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.396253 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.396332 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.396418 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.396498 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.396626 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.396710 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.396826 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.396991 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.397142 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.397291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.397450 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.397599 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.397755 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.397906 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.398062 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.398211 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.398372 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.398522 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.398677 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.398838 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.398988 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.399146 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.399295 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.399443 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.399591 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.399739 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.399888 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.400047 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.400204 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.400354 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.400502 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.400718 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.400872 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.401039 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.401197 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.401347 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.401496 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.401644 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.401792 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.402016 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.402169 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.402318 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.402466 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.402656 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.402835 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.402986 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.403136 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.403285 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.403443 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.403592 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.403755 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.403904 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.404619 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.404800 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.404963 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.405113 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.405283 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.405459 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.405610 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.405758 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.405907 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.406066 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.406216 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.406366 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.406513 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.406662 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.406810 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.406972 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.407122 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.407281 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.407431 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.407587 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.407737 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 09:28:06.407895 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.407895 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.408179 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.408326 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.408627 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.408940 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.409250 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.409561 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.409871 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.410187 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.410496 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.410805 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.411121 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.411436 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.411764 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.412089 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.412401 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.412753 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.413080 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.413425 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.413738 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.414083 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.414414 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.414730 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.415041 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.415348 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:28:06.415592 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 09:28:06.559428 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO dbcounter [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Registered counter for database nova_api Oct 27 09:28:06.567615 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO dbcounter [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Registered counter for database nova_api Oct 27 09:28:06.580920 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_db.sqlalchemy.engines [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:28:06.587133 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG oslo_db.sqlalchemy.engines [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:28:06.587423 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writer thread running {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:28:06.594401 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writer thread running {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:28:06.643141 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.context [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbb9bbb7-d276-4c35-b3e7-86f2907dac7c(cell1) {{(pid=103907) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 09:28:06.646983 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:06.647447 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:06.649049 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:06.649750 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:06.649862 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.context [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbb9bbb7-d276-4c35-b3e7-86f2907dac7c(cell1) {{(pid=103908) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 09:28:06.650188 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:06.652164 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:06.653632 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG oslo_concurrency.lockutils [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:06.654600 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG oslo_concurrency.lockutils [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:06.654835 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO dbcounter [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Registered counter for database nova_cell0 Oct 27 09:28:06.656192 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG oslo_concurrency.lockutils [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:06.656936 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG oslo_concurrency.lockutils [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:28:06.657388 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG oslo_concurrency.lockutils [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:28:06.658873 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO dbcounter [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Registered counter for database nova_cell1 Oct 27 09:28:06.659389 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG oslo_concurrency.lockutils [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:28:06.661399 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO dbcounter [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Registered counter for database nova_cell0 Oct 27 09:28:06.665547 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO dbcounter [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Registered counter for database nova_cell1 Oct 27 09:28:06.665704 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_db.sqlalchemy.engines [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:28:06.667283 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_db.sqlalchemy.engines [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:28:06.672215 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writer thread running {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:28:06.672988 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG oslo_db.sqlalchemy.engines [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:28:06.676743 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG oslo_db.sqlalchemy.engines [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:28:06.678242 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writer thread running {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:28:06.808755 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writer thread running {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:28:06.819098 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO dbcounter [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Registered counter for database nova_cell0 Oct 27 09:28:06.819223 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writer thread running {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:28:06.827813 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO dbcounter [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Registered counter for database nova_cell0 Oct 27 09:28:06.827972 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_db.sqlalchemy.engines [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:28:06.832618 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writer thread running {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:28:06.836442 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG oslo_db.sqlalchemy.engines [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:28:06.841574 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writer thread running {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:28:07.165240 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: WARNING keystonemiddleware.auth_token [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:28:07.169835 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: WARNING keystonemiddleware.auth_token [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:28:07.172529 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: WARNING keystonemiddleware.auth_token [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:28:07.177023 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: WARNING keystonemiddleware.auth_token [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:28:07.510691 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: WARNING keystonemiddleware.auth_token [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:28:07.517119 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: WARNING keystonemiddleware.auth_token [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:28:07.518800 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: WARNING keystonemiddleware.auth_token [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:28:07.522317 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56411b2bd9c0 pid: 103907 (default app) Oct 27 09:28:07.524339 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:28:07.524772 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: WARNING keystonemiddleware.auth_token [None req-68b0fe32-797d-4629-b074-c14b8f009153 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:28:07.525549 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001721 Oct 27 09:28:07.525959 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Thu Oct 27 09:28:07 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:28:07.530161 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56411b2bd9c0 pid: 103908 (default app) Oct 27 09:29:28.876432 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:28.877483 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 27 09:29:28.877890 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:29:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:28.890344 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_api:SELECT=3 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:28.891492 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_cell0:SELECT=3 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:28.892343 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_cell1:SELECT=3 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:28.895276 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:29.774284 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-4f5519b2-9240-4007-9af8-020f1227f1c6 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:29.807993 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-4f5519b2-9240-4007-9af8-020f1227f1c6 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.923286 Oct 27 09:29:29.808943 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 1/3] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Oct 27 09:29:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:32.416051 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:32.417101 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-030184c5-0151-4fcd-bed6-5f06fa86d623 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002012 Oct 27 09:29:32.417504 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 3/4] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:29:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:32.877107 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-b47c655a-5d7b-4c7a-99ef-f79708c3083b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "swap": 0, "vcpus": 1, "disk": 1, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:32.924904 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-b47c655a-5d7b-4c7a-99ef-f79708c3083b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.501158 Oct 27 09:29:32.925475 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 2/5] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Oct 27 09:29:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:29:32.941678 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writing DB stats nova_api:SELECT=3 {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:32.942602 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writing DB stats nova_cell0:SELECT=3 {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:32.944557 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writing DB stats nova_cell1:SELECT=3 {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:32.945325 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:29:33.150170 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-a86e9402-8d77-4b47-b57e-c9217d5efea8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:33.224278 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-a86e9402-8d77-4b47-b57e-c9217d5efea8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290268 Oct 27 09:29:33.224953 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 4/6] 10.222.0.70 () {64 vars in 1336 bytes} [Thu Oct 27 09:29:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:35.833489 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-b47c655a-5d7b-4c7a-99ef-f79708c3083b admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:35.834520 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-b47c655a-5d7b-4c7a-99ef-f79708c3083b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 27 09:29:35.834923 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 3/7] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:29:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:36.513487 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-9adac03f-63dd-4385-ba4a-d5a4fe909a1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "ram": 512, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:36.558072 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-9adac03f-63dd-4385-ba4a-d5a4fe909a1d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.716264 Oct 27 09:29:36.558640 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 5/8] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Oct 27 09:29:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:29:36.571052 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-a3d3be44-9562-41f7-a81f-76277fffca76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:36.613057 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-a3d3be44-9562-41f7-a81f-76277fffca76 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045665 Oct 27 09:29:36.613815 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 4/9] 10.222.0.70 () {64 vars in 1336 bytes} [Thu Oct 27 09:29:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:39.219818 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-9adac03f-63dd-4385-ba4a-d5a4fe909a1d admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:39.220878 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-9adac03f-63dd-4385-ba4a-d5a4fe909a1d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 27 09:29:39.221296 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:29:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:39.642495 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-4aaeefd2-f248-498a-a52d-b80e072bb7aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:39.661804 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-4aaeefd2-f248-498a-a52d-b80e072bb7aa admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433206 Oct 27 09:29:39.662354 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 5/11] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Oct 27 09:29:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:29:39.674694 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-4cd6e772-46e9-43ff-887b-ee6cb7b7ba1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:39.704324 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-4cd6e772-46e9-43ff-887b-ee6cb7b7ba1e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033187 Oct 27 09:29:39.704959 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 7/12] 10.222.0.70 () {64 vars in 1336 bytes} [Thu Oct 27 09:29:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:29:42.330019 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-4aaeefd2-f248-498a-a52d-b80e072bb7aa admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:42.331033 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-4aaeefd2-f248-498a-a52d-b80e072bb7aa admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 27 09:29:42.331434 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 6/13] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:42.747286 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-eaca6f42-c952-4a01-8d80-342e8b71839c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "id": "d3", "ram": 2048}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:42.767194 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-eaca6f42-c952-4a01-8d80-342e8b71839c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429701 Oct 27 09:29:42.767907 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 8/14] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Oct 27 09:29:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:29:42.784768 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-6ca93183-38b7-4880-9325-b7fef8e19727 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:42.812826 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-6ca93183-38b7-4880-9325-b7fef8e19727 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033230 Oct 27 09:29:42.813507 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 7/15] 10.222.0.70 () {64 vars in 1336 bytes} [Thu Oct 27 09:29:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:45.444413 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-eaca6f42-c952-4a01-8d80-342e8b71839c admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:45.445734 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-eaca6f42-c952-4a01-8d80-342e8b71839c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 Oct 27 09:29:45.446473 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 9/16] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:45.865916 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-98a4ec15-9186-490e-8c83-6b0392e93356 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:45.887193 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-98a4ec15-9186-490e-8c83-6b0392e93356 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434695 Oct 27 09:29:45.887741 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 8/17] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Oct 27 09:29:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:29:45.900305 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-8db13516-74dd-4ab1-91dc-6a37b6755a54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:45.924595 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-8db13516-74dd-4ab1-91dc-6a37b6755a54 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028446 Oct 27 09:29:45.925170 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 10/18] 10.222.0.70 () {64 vars in 1336 bytes} [Thu Oct 27 09:29:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:48.528980 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-98a4ec15-9186-490e-8c83-6b0392e93356 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:48.530040 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-98a4ec15-9186-490e-8c83-6b0392e93356 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Oct 27 09:29:48.530466 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 9/19] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:29:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:48.983638 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-bc86b3e3-6dad-48fa-bb7d-003921e03281 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:49.009275 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-bc86b3e3-6dad-48fa-bb7d-003921e03281 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.471734 Oct 27 09:29:49.009829 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 11/20] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Oct 27 09:29:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:29:51.899937 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-98a4ec15-9186-490e-8c83-6b0392e93356 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:51.900992 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-98a4ec15-9186-490e-8c83-6b0392e93356 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Oct 27 09:29:51.901395 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 10/21] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:29:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:52.292743 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-0fe947c1-d4cb-423c-ada8-a9cd3a7355e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:52.312619 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-0fe947c1-d4cb-423c-ada8-a9cd3a7355e9 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.405100 Oct 27 09:29:52.313169 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 12/22] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Oct 27 09:29:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:29:52.325448 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-99b7a879-291f-419c-8d9f-40125c76c814 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:52.353076 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-99b7a879-291f-419c-8d9f-40125c76c814 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030718 Oct 27 09:29:52.353654 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 11/23] 10.222.0.70 () {64 vars in 1333 bytes} [Thu Oct 27 09:29:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:54.954818 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-0fe947c1-d4cb-423c-ada8-a9cd3a7355e9 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:54.956296 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-0fe947c1-d4cb-423c-ada8-a9cd3a7355e9 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001896 Oct 27 09:29:54.956895 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:29:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:55.383882 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-dca18984-8c24-4e07-a8a8-fa13af7c3d33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:55.405563 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-dca18984-8c24-4e07-a8a8-fa13af7c3d33 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.441955 Oct 27 09:29:55.406362 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 12/25] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Oct 27 09:29:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:29:55.417966 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-5b75e98c-edbd-4fb9-9d59-70cd85bdcb4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:55.441610 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-5b75e98c-edbd-4fb9-9d59-70cd85bdcb4d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027216 Oct 27 09:29:55.442183 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 14/26] 10.222.0.70 () {64 vars in 1333 bytes} [Thu Oct 27 09:29:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:29:58.104491 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-dca18984-8c24-4e07-a8a8-fa13af7c3d33 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:29:58.105519 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-dca18984-8c24-4e07-a8a8-fa13af7c3d33 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 27 09:29:58.105925 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 13/27] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:29:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:29:58.561604 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-23241504-eb4c-47af-baf9-f86f8f3b147e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "swap": 0}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:58.582355 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-23241504-eb4c-47af-baf9-f86f8f3b147e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.469344 Oct 27 09:29:58.583373 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 15/28] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Oct 27 09:29:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:29:58.597452 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-5841d706-1643-42ff-9a43-ceedbac4483a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:29:58.628406 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-5841d706-1643-42ff-9a43-ceedbac4483a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034638 Oct 27 09:29:58.629171 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 14/29] 10.222.0.70 () {64 vars in 1333 bytes} [Thu Oct 27 09:29:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:01.232825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-23241504-eb4c-47af-baf9-f86f8f3b147e admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:01.233835 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-23241504-eb4c-47af-baf9-f86f8f3b147e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 27 09:30:01.234235 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 16/30] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:30:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:01.693966 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-414ea9a5-47db-4517-aeb2-930a9270e385 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "swap": 0, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:01.701182 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:01.719264 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-414ea9a5-47db-4517-aeb2-930a9270e385 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479090 Oct 27 09:30:01.719834 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 15/31] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Oct 27 09:30:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:30:01.732168 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-7d9bd695-574f-487d-acb3-597f0d91cec1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:01.759892 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-7d9bd695-574f-487d-acb3-597f0d91cec1 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031553 Oct 27 09:30:01.760608 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 17/32] 10.222.0.70 () {64 vars in 1333 bytes} [Thu Oct 27 09:30:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:04.449048 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-414ea9a5-47db-4517-aeb2-930a9270e385 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:04.450660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-414ea9a5-47db-4517-aeb2-930a9270e385 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Oct 27 09:30:04.451068 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 16/33] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:30:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:04.889627 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-9810437a-90c2-4bd1-b1d4-6a95ee0d9dd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "swap": 0, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "disk": 160}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:04.895708 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:04.911228 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-9810437a-90c2-4bd1-b1d4-6a95ee0d9dd6 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454039 Oct 27 09:30:04.911762 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 18/34] 10.222.0.70 () {64 vars in 1283 bytes} [Thu Oct 27 09:30:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:30:04.924943 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-1bf3c087-2949-43a5-bea8-2487bd018a81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:04.953232 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-1bf3c087-2949-43a5-bea8-2487bd018a81 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032741 Oct 27 09:30:04.954175 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 17/35] 10.222.0.70 () {64 vars in 1333 bytes} [Thu Oct 27 09:30:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:30:22.057371 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-9810437a-90c2-4bd1-b1d4-6a95ee0d9dd6 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:22.058309 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-9810437a-90c2-4bd1-b1d4-6a95ee0d9dd6 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 27 09:30:22.058719 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 19/36] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:30:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:22.069229 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:30:22.450407 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-28a13bf4-9296-4b85-9484-3415a62d06c8 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:22.468328 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-28a13bf4-9296-4b85-9484-3415a62d06c8 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403662 Oct 27 09:30:22.468898 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Oct 27 09:30:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:30:23.750613 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-9810437a-90c2-4bd1-b1d4-6a95ee0d9dd6 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:23.751618 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-9810437a-90c2-4bd1-b1d4-6a95ee0d9dd6 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 27 09:30:23.752022 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 20/38] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:30:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:24.281622 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-85cba64f-7046-4498-b191-59656f3e8331 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:24.286961 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.wsgi [None req-85cba64f-7046-4498-b191-59656f3e8331 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-85cba64f-7046-4498-b191-59656f3e8331 admin admin] Request method failure captured: Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Accept: application/json Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Accept-Encoding: gzip, deflate Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Connection: keep-alive Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Content-Length: 0 Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Host: 10.222.0.70 Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Openstack-Api-Version: compute 2.92 Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Openstack-System-Scope: None Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: User-Agent: python-novaclient Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Auth-Token: gAAAAABjWk-v2fArEyQemqZ5q3qY2eLuM_2kka1A__HsKXStHFC_5_yw4RESZtdG0MkVxHfLLz_VfRptjd1m8GXfeRGxA-SOn5r8vaB-lbeuBx29C582PIwGy5IrjaBjDMIoF8pbxmEk6ILcU0dg3OYLz9eauxBMxKkDfyKowxfvyjnPUXvfwtU Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Domain-Id: None Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Domain-Name: None Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Identity-Status: Confirmed Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Is-Admin-Project: True Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Domain-Id: default Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Domain-Name: Default Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Name: admin Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Role: member,reader,admin Oct 27 09:30:24.290680 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Roles: member,reader,admin Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Tenant: admin Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Tenant-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Tenant-Name: admin Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User: admin Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Domain-Id: default Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Domain-Name: Default Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Id: 4e3d5d12b2ba49459e93d0a715783a8a Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Name: admin Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: method: > Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: exception: Flavor 42 could not be found. Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: action_args: {'id': '42'} Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:24.292291 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:24.293368 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:24.294484 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-85cba64f-7046-4498-b191-59656f3e8331 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:24.295608 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-85cba64f-7046-4498-b191-59656f3e8331 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.389507 Oct 27 09:30:24.295608 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 19/39] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Oct 27 09:30:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:30:24.301547 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-8696482c-bcd3-4537-8bc9-0dcfce47b876 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:24.324463 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-8696482c-bcd3-4537-8bc9-0dcfce47b876 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026384 Oct 27 09:30:24.325031 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 21/40] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Oct 27 09:30:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:30:24.335533 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-53db1abf-9c5a-46d0-bec4-ba721738c24c admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:24.357719 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-53db1abf-9c5a-46d0-bec4-ba721738c24c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026622 Oct 27 09:30:24.358259 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 20/41] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Oct 27 09:30:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:30:24.368036 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-bd7fd7c1-885b-4045-b885-c2f21bf42930 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:24.373331 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.wsgi [None req-bd7fd7c1-885b-4045-b885-c2f21bf42930 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-bd7fd7c1-885b-4045-b885-c2f21bf42930 admin admin] Request method failure captured: Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Accept: application/json Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Accept-Encoding: gzip, deflate Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Connection: keep-alive Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Content-Length: 0 Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Host: 10.222.0.70 Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Openstack-Api-Version: compute 2.92 Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Openstack-System-Scope: None Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: User-Agent: python-novaclient Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Auth-Token: gAAAAABjWk-v2fArEyQemqZ5q3qY2eLuM_2kka1A__HsKXStHFC_5_yw4RESZtdG0MkVxHfLLz_VfRptjd1m8GXfeRGxA-SOn5r8vaB-lbeuBx29C582PIwGy5IrjaBjDMIoF8pbxmEk6ILcU0dg3OYLz9eauxBMxKkDfyKowxfvyjnPUXvfwtU Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Domain-Id: None Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Domain-Name: None Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Identity-Status: Confirmed Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Is-Admin-Project: True Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Domain-Id: default Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Domain-Name: Default Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Name: admin Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Role: member,reader,admin Oct 27 09:30:24.376548 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Roles: member,reader,admin Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Tenant: admin Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Tenant-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Tenant-Name: admin Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User: admin Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Domain-Id: default Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Domain-Name: Default Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Id: 4e3d5d12b2ba49459e93d0a715783a8a Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Name: admin Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: method: > Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: exception: Flavor 42 could not be found. Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: action_args: {'id': '42'} Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:24.378104 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:24.378974 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:24.380404 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-bd7fd7c1-885b-4045-b885-c2f21bf42930 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:24.381633 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-bd7fd7c1-885b-4045-b885-c2f21bf42930 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014001 Oct 27 09:30:24.381633 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 22/42] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Oct 27 09:30:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:30:25.582370 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-53db1abf-9c5a-46d0-bec4-ba721738c24c admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:25.583407 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-53db1abf-9c5a-46d0-bec4-ba721738c24c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 27 09:30:25.583802 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 21/43] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:30:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:26.101233 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-bb518861-2e0d-4664-888d-e6b4cdf85d1e admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:26.106269 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.wsgi [None req-bb518861-2e0d-4664-888d-e6b4cdf85d1e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-bb518861-2e0d-4664-888d-e6b4cdf85d1e admin admin] Request method failure captured: Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Accept: application/json Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Accept-Encoding: gzip, deflate Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Connection: keep-alive Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Content-Length: 0 Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Host: 10.222.0.70 Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Openstack-Api-Version: compute 2.92 Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Openstack-System-Scope: None Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: User-Agent: python-novaclient Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Auth-Token: gAAAAABjWk-xeIwtLH3YAU01CQ5O8e7vVACTMUPO1LkAIqdB_pBGOMpl5Bv80NbfDq0jGtFb2zWhqwbSeqil6rDuy_ZFrk24iIE41ha_1-ilZoaCtguhOZyBd51qHd5OI8-MsdGPRuQc9Qgsvu4-5J7mKtYQAQYCTSoOA4nJP-4xvrD-_WdSe_Y Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Domain-Id: None Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Domain-Name: None Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Identity-Status: Confirmed Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Is-Admin-Project: True Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Domain-Id: default Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Domain-Name: Default Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Name: admin Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Role: member,reader,admin Oct 27 09:30:26.107771 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Roles: member,reader,admin Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Tenant: admin Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Tenant-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Tenant-Name: admin Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User: admin Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Domain-Id: default Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Domain-Name: Default Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Id: 4e3d5d12b2ba49459e93d0a715783a8a Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Name: admin Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: method: > Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: exception: Flavor 84 could not be found. Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: action_args: {'id': '84'} Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:26.109270 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:26.110227 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:26.111248 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-bb518861-2e0d-4664-888d-e6b4cdf85d1e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:26.112350 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-bb518861-2e0d-4664-888d-e6b4cdf85d1e admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387764 Oct 27 09:30:26.112350 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Oct 27 09:30:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:30:26.118833 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-45eaacb9-2420-4338-a8d1-f3dc17fd9495 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:26.133414 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-45eaacb9-2420-4338-a8d1-f3dc17fd9495 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018047 Oct 27 09:30:26.133863 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 22/45] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Oct 27 09:30:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:30:26.143998 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-13bd3559-7fd5-401d-9463-4223a067bd23 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:26.160250 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-13bd3559-7fd5-401d-9463-4223a067bd23 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020032 Oct 27 09:30:26.160250 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 24/46] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Oct 27 09:30:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:30:26.170222 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-a7ce0541-68c7-4a3b-8a36-540f70cd2b65 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:26.175174 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.wsgi [None req-a7ce0541-68c7-4a3b-8a36-540f70cd2b65 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-a7ce0541-68c7-4a3b-8a36-540f70cd2b65 admin admin] Request method failure captured: Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Accept: application/json Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Accept-Encoding: gzip, deflate Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Connection: keep-alive Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Content-Length: 0 Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Host: 10.222.0.70 Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Openstack-Api-Version: compute 2.92 Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Openstack-System-Scope: None Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: User-Agent: python-novaclient Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Auth-Token: gAAAAABjWk-xeIwtLH3YAU01CQ5O8e7vVACTMUPO1LkAIqdB_pBGOMpl5Bv80NbfDq0jGtFb2zWhqwbSeqil6rDuy_ZFrk24iIE41ha_1-ilZoaCtguhOZyBd51qHd5OI8-MsdGPRuQc9Qgsvu4-5J7mKtYQAQYCTSoOA4nJP-4xvrD-_WdSe_Y Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Domain-Id: None Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Domain-Name: None Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Identity-Status: Confirmed Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Is-Admin-Project: True Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Domain-Id: default Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Domain-Name: Default Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Name: admin Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Role: member,reader,admin Oct 27 09:30:26.176703 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Roles: member,reader,admin Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Tenant: admin Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Tenant-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Tenant-Name: admin Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User: admin Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Domain-Id: default Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Domain-Name: Default Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Id: 4e3d5d12b2ba49459e93d0a715783a8a Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Name: admin Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: method: > Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: exception: Flavor 84 could not be found. Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: action_args: {'id': '84'} Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:26.178214 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:26.179227 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:26.180660 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-a7ce0541-68c7-4a3b-8a36-540f70cd2b65 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:26.182034 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-a7ce0541-68c7-4a3b-8a36-540f70cd2b65 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011355 Oct 27 09:30:26.182034 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 23/47] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Oct 27 09:30:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 27 09:30:27.386705 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-13bd3559-7fd5-401d-9463-4223a067bd23 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:27.387813 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-13bd3559-7fd5-401d-9463-4223a067bd23 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Oct 27 09:30:27.388282 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 25/48] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:30:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:27.925119 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-80497e17-3fce-41e0-874e-80afe56cf7e7 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:27.932269 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.wsgi [None req-80497e17-3fce-41e0-874e-80afe56cf7e7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-80497e17-3fce-41e0-874e-80afe56cf7e7 admin admin] Request method failure captured: Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Accept: application/json Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Accept-Encoding: gzip, deflate Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Connection: keep-alive Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Content-Length: 0 Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Host: 10.222.0.70 Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Openstack-Api-Version: compute 2.92 Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Openstack-System-Scope: None Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: User-Agent: python-novaclient Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Auth-Token: gAAAAABjWk-zJekniQeOigLRySZZ24UDLrbcenzOKXOWzymZyQ2qLK6FdNZfUL-blvT7elPPn1wDT83D74M0xDnbMcfVIys3XiQTCaOjmiH1rWdvHnm0t_KaYWFjXAiOkDp8ls26NY2eQDGi6amsXl5JZDQEeDoUBPT_2dEL80Ru1sognaTvcYk Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Domain-Id: None Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Domain-Name: None Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Identity-Status: Confirmed Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Is-Admin-Project: True Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Domain-Id: default Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Domain-Name: Default Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Project-Name: admin Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Role: member,reader,admin Oct 27 09:30:27.933842 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Roles: member,reader,admin Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Tenant: admin Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Tenant-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-Tenant-Name: admin Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User: admin Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Domain-Id: default Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Domain-Name: Default Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Id: 4e3d5d12b2ba49459e93d0a715783a8a Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: X-User-Name: admin Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: method: > Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: exception: Flavor 451 could not be found. Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: action_args: {'id': '451'} Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:27.935373 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:27.937094 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: ERROR nova.api.openstack.wsgi Oct 27 09:30:27.938172 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-80497e17-3fce-41e0-874e-80afe56cf7e7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:27.939153 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-80497e17-3fce-41e0-874e-80afe56cf7e7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.409318 Oct 27 09:30:27.939153 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 24/49] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Oct 27 09:30:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:30:27.945691 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-c63d61c9-635d-434a-beb4-02cec0745eb0 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:27.961921 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-c63d61c9-635d-434a-beb4-02cec0745eb0 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020277 Oct 27 09:30:27.962515 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 26/50] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Oct 27 09:30:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:30:27.972742 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:27.987739 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018507 Oct 27 09:30:27.988365 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 25/51] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Oct 27 09:30:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:30:27.997845 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-741f9061-1a20-4486-a2d4-e3830587abcf admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:28.002861 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.wsgi [None req-741f9061-1a20-4486-a2d4-e3830587abcf admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-741f9061-1a20-4486-a2d4-e3830587abcf admin admin] Request method failure captured: Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Accept: application/json Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Accept-Encoding: gzip, deflate Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Connection: keep-alive Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Content-Length: 0 Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Host: 10.222.0.70 Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Openstack-Api-Version: compute 2.92 Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Openstack-System-Scope: None Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: User-Agent: python-novaclient Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Auth-Token: gAAAAABjWk-zJekniQeOigLRySZZ24UDLrbcenzOKXOWzymZyQ2qLK6FdNZfUL-blvT7elPPn1wDT83D74M0xDnbMcfVIys3XiQTCaOjmiH1rWdvHnm0t_KaYWFjXAiOkDp8ls26NY2eQDGi6amsXl5JZDQEeDoUBPT_2dEL80Ru1sognaTvcYk Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Domain-Id: None Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Domain-Name: None Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Identity-Status: Confirmed Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Is-Admin-Project: True Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Domain-Id: default Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Domain-Name: Default Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Project-Name: admin Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Role: member,reader,admin Oct 27 09:30:28.005163 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Roles: member,reader,admin Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d2f8e01e4d9d43978ddeb5033ead57f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Tenant: admin Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Tenant-Id: d2f8e01e4d9d43978ddeb5033ead57f5 Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-Tenant-Name: admin Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User: admin Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Domain-Id: default Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Domain-Name: Default Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Id: 4e3d5d12b2ba49459e93d0a715783a8a Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: X-User-Name: admin Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: method: > Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: exception: Flavor 451 could not be found. Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: action_args: {'id': '451'} Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:30:28.006933 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:28.007712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: ERROR nova.api.openstack.wsgi Oct 27 09:30:28.008825 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-741f9061-1a20-4486-a2d4-e3830587abcf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:30:28.009899 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-741f9061-1a20-4486-a2d4-e3830587abcf admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013520 Oct 27 09:30:28.020755 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 27/52] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Oct 27 09:30:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 09:30:29.281142 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:29.282176 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Oct 27 09:30:29.282578 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:30:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:29.827077 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-206ba122-aef6-40a2-9676-93ba00d96f18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:29.849889 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-206ba122-aef6-40a2-9676-93ba00d96f18 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.428340 Oct 27 09:30:29.851030 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 28/54] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Oct 27 09:30:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:30:31.088304 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:31.089353 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001752 Oct 27 09:30:31.089766 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:30:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:31.639962 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-777cc565-7c64-40ea-a166-b6b7a3268192 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:31.660258 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-777cc565-7c64-40ea-a166-b6b7a3268192 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.429520 Oct 27 09:30:31.660988 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 29/56] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Oct 27 09:30:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:30:32.884034 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:32.885105 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Oct 27 09:30:32.885496 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:30:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:33.433295 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-d0d99f8a-5b42-4272-8300-31e4570b7866 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:33.452431 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-d0d99f8a-5b42-4272-8300-31e4570b7866 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.428027 Oct 27 09:30:33.453025 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 30/58] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Oct 27 09:30:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:30:34.659157 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:34.660203 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 27 09:30:34.660638 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 29/59] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:30:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:35.175549 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-9c267773-59c7-45c7-95b5-5f39e7771904 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:30:35.194096 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-9c267773-59c7-45c7-95b5-5f39e7771904 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396304 Oct 27 09:30:35.194627 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 31/60] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Oct 27 09:30:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:30:36.405369 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:36.406386 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 27 09:30:36.406790 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 30/61] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:30:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:30:36.923157 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-c5d40d01-01c8-46aa-9a0e-1c8377a6aa83 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:30:36.942751 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-c5d40d01-01c8-46aa-9a0e-1c8377a6aa83 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398664 Oct 27 09:30:36.943283 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 32/62] 10.222.0.70 () {60 vars in 1202 bytes} [Thu Oct 27 09:30:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:31:33.220317 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:33.221388 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8e79e303-6084-4d22-bf5f-2f0b7d54336a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 27 09:31:33.222279 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 31/63] 10.222.0.70 () {54 vars in 931 bytes} [Thu Oct 27 09:31:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:31:33.232781 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:33.609923 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-2f969e71-db9c-45bd-8f97-d7aad1cc0874 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:33.630101 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-2f969e71-db9c-45bd-8f97-d7aad1cc0874 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401676 Oct 27 09:31:33.630643 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 33/64] 10.222.0.70 () {60 vars in 1292 bytes} [Thu Oct 27 09:31:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:31:33.652115 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_api:SELECT=14 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:31:33.656174 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-e4c0a69e-a79c-46eb-9dd5-f53122512c0c admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:33.664130 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-e4c0a69e-a79c-46eb-9dd5-f53122512c0c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013408 Oct 27 09:31:33.664694 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 32/65] 10.222.0.70 () {60 vars in 1283 bytes} [Thu Oct 27 09:31:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:33.676316 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-0f59fb6a-5223-4ffd-893e-b646bdcfe388 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:33.683466 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-0f59fb6a-5223-4ffd-893e-b646bdcfe388 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010896 Oct 27 09:31:33.683988 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 34/66] 10.222.0.70 () {60 vars in 1286 bytes} [Thu Oct 27 09:31:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:33.695097 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8422c575-d3ed-4c38-b2b3-4e464bc85a51 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:33.702123 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8422c575-d3ed-4c38-b2b3-4e464bc85a51 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010526 Oct 27 09:31:33.702640 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 33/67] 10.222.0.70 () {60 vars in 1286 bytes} [Thu Oct 27 09:31:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:31:33.714400 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-f7af3150-2713-415a-8728-321eb9877d67 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:31:33.721355 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-f7af3150-2713-415a-8728-321eb9877d67 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010656 Oct 27 09:31:33.722416 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 35/68] 10.222.0.70 () {60 vars in 1283 bytes} [Thu Oct 27 09:31:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:34:31.000351 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8422c575-d3ed-4c38-b2b3-4e464bc85a51 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:31.001434 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8422c575-d3ed-4c38-b2b3-4e464bc85a51 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Oct 27 09:34:31.001853 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 34/69] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:34:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:31.142487 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writing DB stats nova_api:SELECT=6 {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:31.298982 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-7d238e6a-1ceb-4bb0-a05d-c6d2cf1cdb79 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:31.303654 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-7d238e6a-1ceb-4bb0-a05d-c6d2cf1cdb79 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:31.304153 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-7d238e6a-1ceb-4bb0-a05d-c6d2cf1cdb79 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:31.304583 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-7d238e6a-1ceb-4bb0-a05d-c6d2cf1cdb79 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:31.305299 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-7d238e6a-1ceb-4bb0-a05d-c6d2cf1cdb79 admin admin] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:31.305749 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-7d238e6a-1ceb-4bb0-a05d-c6d2cf1cdb79 admin admin] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:31.306177 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-7d238e6a-1ceb-4bb0-a05d-c6d2cf1cdb79 admin admin] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:31.338296 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-7d238e6a-1ceb-4bb0-a05d-c6d2cf1cdb79 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.196858 Oct 27 09:34:31.338893 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 36/70] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Oct 27 09:34:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:34:32.409757 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8422c575-d3ed-4c38-b2b3-4e464bc85a51 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:32.410766 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8422c575-d3ed-4c38-b2b3-4e464bc85a51 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Oct 27 09:34:32.411199 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 35/71] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:34:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:32.600136 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-c840811d-4897-4822-a9ad-0c4620c5f31b admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:32.603583 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-c840811d-4897-4822-a9ad-0c4620c5f31b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:32.604060 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-c840811d-4897-4822-a9ad-0c4620c5f31b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:32.604487 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-c840811d-4897-4822-a9ad-0c4620c5f31b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:32.605229 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-c840811d-4897-4822-a9ad-0c4620c5f31b admin admin] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:32.605673 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-c840811d-4897-4822-a9ad-0c4620c5f31b admin admin] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:32.606637 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-c840811d-4897-4822-a9ad-0c4620c5f31b admin admin] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:32.626077 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-c840811d-4897-4822-a9ad-0c4620c5f31b admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.077522 Oct 27 09:34:32.626615 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 37/72] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Oct 27 09:34:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:34:44.086091 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8422c575-d3ed-4c38-b2b3-4e464bc85a51 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:44.087093 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8422c575-d3ed-4c38-b2b3-4e464bc85a51 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 27 09:34:44.087482 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 36/73] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:34:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:44.231699 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writing DB stats nova_cell0:SELECT=4 {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:44.233147 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writing DB stats nova_cell1:SELECT=4 {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:44.233877 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG dbcounter [-] [103907] Writing DB stats nova_api:SELECT=8 {{(pid=103907) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:34:44.281830 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-be628158-6b8a-4ce3-bff3-16e60de1f178 admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:44.285652 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-be628158-6b8a-4ce3-bff3-16e60de1f178 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:44.285753 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-be628158-6b8a-4ce3-bff3-16e60de1f178 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:44.286116 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-be628158-6b8a-4ce3-bff3-16e60de1f178 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:44.286832 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-be628158-6b8a-4ce3-bff3-16e60de1f178 admin admin] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:44.287289 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-be628158-6b8a-4ce3-bff3-16e60de1f178 admin admin] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:44.287712 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-be628158-6b8a-4ce3-bff3-16e60de1f178 admin admin] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:44.313267 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-be628158-6b8a-4ce3-bff3-16e60de1f178 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086234 Oct 27 09:34:44.313759 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 38/74] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Oct 27 09:34:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:34:45.376663 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG nova.api.openstack.wsgi [None req-8422c575-d3ed-4c38-b2b3-4e464bc85a51 admin admin] Calling method '>' {{(pid=103908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:45.377657 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: INFO nova.api.openstack.requestlog [None req-8422c575-d3ed-4c38-b2b3-4e464bc85a51 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 27 09:34:45.378051 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: [pid: 103908|app: 0|req: 37/75] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Oct 27 09:34:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:34:45.565990 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG nova.api.openstack.wsgi [None req-57e5c424-940b-45bb-bfd3-daf2ff6ca05b admin admin] Calling method '>' {{(pid=103907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:34:45.569400 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-57e5c424-940b-45bb-bfd3-daf2ff6ca05b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:45.569912 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-57e5c424-940b-45bb-bfd3-daf2ff6ca05b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:45.570341 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-57e5c424-940b-45bb-bfd3-daf2ff6ca05b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:45.571061 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-57e5c424-940b-45bb-bfd3-daf2ff6ca05b admin admin] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:34:45.571510 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-57e5c424-940b-45bb-bfd3-daf2ff6ca05b admin admin] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:34:45.571949 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: DEBUG oslo_concurrency.lockutils [None req-57e5c424-940b-45bb-bfd3-daf2ff6ca05b admin admin] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:34:45.594976 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: INFO nova.api.openstack.requestlog [None req-57e5c424-940b-45bb-bfd3-daf2ff6ca05b admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.080362 Oct 27 09:34:45.595537 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: [pid: 103907|app: 0|req: 39/76] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Oct 27 09:34:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:35:43.814456 dv-cinder-797970-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 09:35:43.815223 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: Thu Oct 27 09:35:43 2022 - graceful shutdown triggered... Oct 27 09:35:43.815669 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: Gracefully killing worker 2 (pid: 103908)... Oct 27 09:35:43.816092 dv-cinder-797970-7-iscsi devstack@n-api.service[103907]: Gracefully killing worker 1 (pid: 103907)... Oct 27 09:35:43.941802 dv-cinder-797970-7-iscsi devstack@n-api.service[103908]: DEBUG dbcounter [-] [103908] Writing DB stats nova_api:SELECT=4 {{(pid=103908) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:35:44.815843 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: worker 1 buried after 1 seconds Oct 27 09:35:44.815843 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: worker 2 buried after 1 seconds Oct 27 09:35:44.815843 dv-cinder-797970-7-iscsi devstack@n-api.service[103906]: goodbye to uWSGI. Oct 27 09:35:44.817446 dv-cinder-797970-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 27 09:35:44.818031 dv-cinder-797970-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 09:35:44.820747 dv-cinder-797970-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 09:35:44.837866 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 09:35:44 2022] *** Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: nodename: dv-cinder-797970-7-iscsi Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: machine: x86_64 Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: clock source: unix Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: pcre jit disabled Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: detected number of CPU cores: 4 Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: current working directory: / Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: detected binary path: /usr/bin/uwsgi-core Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: your processes number limit is 47680 Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: your memory page size is 4096 bytes Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: detected max file descriptor number: 2048 Oct 27 09:35:44.839803 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: lock engine: pthread robust mutexes Oct 27 09:35:44.840931 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: thunder lock: enabled Oct 27 09:35:44.840931 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 09:35:44.840931 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 09:35:44.879391 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: Python main interpreter initialized at 0x555611c709c0 Oct 27 09:35:44.879391 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: python threads support enabled Oct 27 09:35:44.879391 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: your server socket listen backlog is limited to 100 connections Oct 27 09:35:44.879391 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: your mercy for graceful operations on workers is 90 seconds Oct 27 09:35:44.879837 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 09:35:44.879837 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: *** Operational MODE: preforking *** Oct 27 09:35:44.880113 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: *** uWSGI is running in multiple interpreter mode *** Oct 27 09:35:44.880278 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: spawned uWSGI master process (pid: 125345) Oct 27 09:35:44.880631 dv-cinder-797970-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 09:35:44.883702 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: spawned uWSGI worker 1 (pid: 125361, cores: 1) Oct 27 09:35:44.883702 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: spawned uWSGI worker 2 (pid: 125362, cores: 1) Oct 27 09:35:44.883702 dv-cinder-797970-7-iscsi devstack@n-api.service[125345]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 09:35:45.539808 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 09:35:45.541156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 09:35:46.793411 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:35:46.793411 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: from cryptography.utils import int_from_bytes Oct 27 09:35:46.794152 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:35:46.794152 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: from cryptography.utils import int_from_bytes Oct 27 09:35:46.794152 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:35:46.794152 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: from cryptography.utils import int_from_bytes Oct 27 09:35:46.794729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 09:35:46.794729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: from cryptography.utils import int_from_bytes Oct 27 09:35:49.254237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 09:35:49.254785 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 09:35:49.255032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 09:35:49.255409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 09:35:49.255673 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 09:35:49.256068 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.256400 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.256752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.257078 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.257413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.257729 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.258056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.258382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.258716 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.258981 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.259080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 09:35:49.259466 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.259561 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 09:35:49.259647 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-7-iscsi {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.259831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 09:35:49.259943 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.260198 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 09:35:49.260300 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.260456 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 09:35:49.260583 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.260869 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.260981 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.261177 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.261280 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.261505 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.261606 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.261816 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.261917 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.262143 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.262318 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.262457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.262774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.262900 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.263090 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.263226 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.263396 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.263519 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.263644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.263778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.263962 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.264065 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.264290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797970-7-iscsi {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.264426 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.264651 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.264756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.264967 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.265081 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.265291 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.265415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.265602 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.265713 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.265898 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.266003 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-7-iscsi {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.266207 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.266355 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.266513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.266666 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.266911 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.267010 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.267312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.267418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.267617 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.267711 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.267931 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.268042 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.268819 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.268973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.269138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.269275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.269451 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.269592 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.269799 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.269929 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.270168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.271584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.271744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.271744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.271979 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.272094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.272208 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.272376 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.272501 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797970-7-iscsi {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.272659 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.272790 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.272918 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.273034 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.273202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.273334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.273456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.273569 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.274016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.274142 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.274267 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.274402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.274559 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.274683 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.280668 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.281079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.281230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.281366 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.281487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.281487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.281725 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.281856 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.281972 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.282086 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.282209 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.282325 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.282439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.282563 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.282676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.282764 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.282857 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.282941 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.283024 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.283118 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.283211 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.283369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.283469 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.283554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.283638 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.283747 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.283842 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.283942 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284036 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284219 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284315 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284412 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284506 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284647 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284742 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284841 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284841 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.284995 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285087 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285462 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285546 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285629 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285717 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.285987 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286161 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286526 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286707 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286800 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.286979 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287062 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287144 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287234 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287340 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287340 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287509 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287877 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.287973 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.288065 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.288148 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.288239 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.288323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.288416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.288501 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.292741 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.293331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.293423 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.293513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.293588 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.293669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.293741 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.293811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.293890 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.293962 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294039 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294117 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294199 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294277 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294381 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294539 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294619 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294691 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294775 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.294934 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295004 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295081 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295159 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295317 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295389 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295531 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.295975 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296054 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296126 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296203 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296274 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296612 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296773 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296845 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296924 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.296924 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297083 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297159 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297308 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297401 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297473 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297549 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297621 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297691 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297767 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297919 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.297996 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298068 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298137 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298235 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298315 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298387 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298628 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298707 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298788 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298866 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.298951 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299023 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299100 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299199 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299296 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299371 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299530 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299608 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299909 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.299990 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.300069 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.300141 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.300211 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.300287 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.300368 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.300446 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.301574 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.301733 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.301883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.302044 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.302208 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.302355 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.302510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.302655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.302808 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.302975 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.303129 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.303876 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.304034 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.304180 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.304326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.304487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.304487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.304812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.304964 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.305116 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.305273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.305446 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.305593 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.305745 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.305891 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.306050 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.306211 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.306365 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.306511 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 09:35:49.306656 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.306806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.306951 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.307110 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.307257 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.307419 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.307565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.307709 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.307853 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.308011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.308159 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.308311 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.308457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.308641 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.308803 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.308950 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.309105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.309260 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.309405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.309558 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.309713 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.309866 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.310025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.310179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.310324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.310475 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.310620 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.310779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.310925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.311078 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.311256 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.311402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.311547 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.311702 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.311848 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.312000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.312146 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.312297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.312446 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.312628 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.312778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.312922 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.313074 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.313230 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.313937 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.314185 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.314346 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.314493 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.314637 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.314782 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.314943 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.315597 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.315764 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.315764 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.316049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.316207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.316366 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.316512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.316730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.316876 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.317022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.317165 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.317326 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.317472 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.317627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.317781 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.317934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.318080 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.318250 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.318395 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.318540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.318692 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.318837 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.319062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.319217 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.319370 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.319516 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.319660 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.319812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.319967 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.320113 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.320276 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.320421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.320595 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.320747 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.320902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.321056 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.321202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.321346 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.321491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.321642 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.321797 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.321943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.322087 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.322256 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.322417 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.322563 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.322721 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.322867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.323018 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.323172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.323318 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.324027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.324285 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.324540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.324695 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.324841 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.325008 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.325168 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.325316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.325462 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.325614 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.325759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.325916 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.326076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.326231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.326380 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.326532 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.326677 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.326832 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.326991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.327138 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.327282 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.327437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.327590 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.327751 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.327904 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.328049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.328202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.328348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.328494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.328701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.328867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.329013 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.329157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.329309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.329454 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.329613 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.329759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.329905 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.330049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.330194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.330338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.330499 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.330705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.331438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.331595 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.331749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.331911 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.332321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.332467 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.332650 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.332798 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.332950 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.333106 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.333261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.333406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.334014 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.334381 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.334539 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.334700 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.334849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.335002 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.335149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.335293 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.335446 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.335601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.335747 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.335901 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.336062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.336233 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.336397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.336569 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.336740 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.336894 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.337046 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.337198 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.337365 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.337518 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.337670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.337829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.337982 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.338135 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.338306 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.338459 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.338610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.338761 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.338921 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.339076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.339242 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.339395 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.339546 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.339705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.339857 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.340019 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.340173 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.340334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.340334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.340667 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.340831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.340998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.340998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.341294 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.341294 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.341584 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.341743 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.341905 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.342057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.342219 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.342390 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.342559 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.342719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.342880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.343032 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.343191 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.343351 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.343504 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.344140 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.345075 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.345075 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.345376 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.345552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.345732 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.345732 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.346151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.346349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.346513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.346666 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.346818 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.346979 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.347140 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.347293 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.347456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.347609 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.347779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.347942 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.348094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.348255 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.348409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.348580 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.348749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.348917 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.349077 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.349237 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.349391 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.349551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.349714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.349885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.350045 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.350205 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.350364 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.350518 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.350683 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.350880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.351043 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.351204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.351357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.351510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.351739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.351895 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.352057 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.352227 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.352390 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.352606 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.352784 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.352939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.353098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.353259 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.353418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.353584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.353747 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.354404 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.354566 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.354732 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.355191 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.355413 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.355585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.355749 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.355902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.356054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.356205 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.356372 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.356544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.356744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.356901 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.357075 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.357236 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.357399 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.357552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.357712 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.357874 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.358028 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.358188 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.358347 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.358501 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.358652 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.358812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.358966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.359136 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.359298 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.359459 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.359619 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.359779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.359933 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.360093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.360247 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.360398 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.360579 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.360746 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.360899 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.361062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.361233 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.361386 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.361544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.361696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.361884 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.362050 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.362212 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.362375 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.362535 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.362688 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.362850 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.363009 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.363170 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.363341 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.363502 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.363654 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.363823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.364481 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.364722 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.364880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.365033 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.365215 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.365572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.365728 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.365881 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.366040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.366213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.366366 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.366541 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.366695 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.366848 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.366999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.367151 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.367323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.367483 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.367644 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.367805 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.367966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.368130 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.368298 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.368459 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.368650 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.368813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.368967 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.369119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.369282 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.369444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.369605 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.369772 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.369945 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.370111 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.370274 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.370429 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.370581 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.370742 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.370903 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.371071 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.371233 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.371395 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.371395 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.371687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.371840 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.372008 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.372165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.372327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.372490 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.372705 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.372867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.372867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.373177 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.373338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.373505 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.373660 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.373820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.373974 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.374648 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.374831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.374997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.375152 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.375304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.375649 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.375811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.375974 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.376138 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.376299 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.376452 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.376452 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.376807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.377098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.377309 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.378016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.378220 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.378411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.378609 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.378850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.378850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.379239 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.380037 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.380275 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.380479 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.380708 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.380867 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.381046 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.381215 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.381377 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.381539 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.381700 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.381853 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.382014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.382182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.382342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.382510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.382676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.382829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.382990 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.383167 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.383167 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.383458 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.383619 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.383779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.383938 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.384104 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.385359 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.385359 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.385870 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.385870 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.386197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.386495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.386664 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.386819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.386980 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.387140 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.387381 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.387537 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.387698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.387851 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.388014 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.388167 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.388330 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.388485 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.388722 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.388878 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.389030 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.389182 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.389350 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.389504 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.389663 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.389816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.389968 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.390135 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.390297 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.390458 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.390612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.390775 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.390927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.391212 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.391397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.391554 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.391706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.391706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.391995 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.392158 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.392318 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.392481 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.392659 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.392826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.392990 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.393208 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.393865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.394020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.394208 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.394395 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.394973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.395137 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.395479 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.395646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.395819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.396193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.396444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.396731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.396892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.397045 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.397197 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.397349 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.397520 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.397675 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.397836 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.397989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.398141 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.398293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.398459 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.398623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.398777 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.398929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.399089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.399251 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.399412 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.399576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.399744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.399907 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.400069 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.400235 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.400389 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.400561 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.400731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.400885 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.401037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.401205 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.401370 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.401531 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.401691 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.401852 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.402006 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.402236 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.402450 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.402622 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.402776 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.402945 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.403112 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.403273 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.403433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.403594 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.403746 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.403913 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.404068 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.404323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.404491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.405005 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.405177 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.405365 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.406033 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.406316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.406561 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.406739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.406974 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.407149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.407304 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.407465 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.407625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.407786 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.407947 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.410305 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.410505 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.410669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.410840 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.410997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.411167 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.411326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.411488 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.411488 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.411780 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.411940 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.412105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.412268 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.412423 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.412660 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.412829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.412990 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.413171 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.413327 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.413481 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.418290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.419595 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.419768 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.419936 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.420103 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.420259 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.420423 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.420642 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.420815 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.420970 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.421139 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.421293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.421447 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.421611 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.421766 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.421928 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.422091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.422254 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.422415 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.422586 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.422747 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.422916 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.423070 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.423231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.423385 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.423545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.423708 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.423877 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.424038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.424197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.424378 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.424565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.424726 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.424920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.425165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.425573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.425741 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.425903 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.426059 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.426243 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.426398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.426550 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.426704 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.426857 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.427019 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.427419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.427588 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.427749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.427903 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.428065 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.428260 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.428602 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.428776 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.428939 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.429099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.429263 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.429425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.429579 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.429732 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.429893 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.430047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.430201 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.430367 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.430521 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.430684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.430845 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.430998 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.431151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.431460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.431628 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.431784 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.431784 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.431784 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.432244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.432400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.432591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.432770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.432936 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.433090 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.433252 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.433407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.433560 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.433713 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.433866 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.434018 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.434185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.434348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.434515 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.434677 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.434830 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.434995 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.435181 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.435435 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.435792 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.435966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.436129 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.436298 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.436456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.436637 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.436792 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.436792 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.437094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.437285 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.437655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.437819 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.437973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.438134 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.438289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.438457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.438807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.438969 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.439131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.439284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.439438 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.439671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.439671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.440543 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.440543 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.440856 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.440856 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.441160 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.441313 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.441465 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.441465 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.441771 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.441934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.442088 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.442242 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.442405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.442558 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.442720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.442884 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.443047 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.443201 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.443361 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.443516 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.443669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.443837 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.444001 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.444163 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.444316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.444479 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.444690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.444892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.445058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.445212 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.445390 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.445628 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.446064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.446227 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.446382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.446536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.446703 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.446703 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.447027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.447189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.447350 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.447350 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.447881 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.448038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.448192 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.448352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.448698 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449379 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.449833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.451355 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.451511 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.451665 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.451819 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.451997 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.452160 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.452327 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.452489 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.452684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.452849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.453021 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.453178 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.453346 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.453501 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.453663 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.453825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.453825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.454128 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.454292 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.454455 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.454621 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.454782 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.454944 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.455114 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.455269 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.455495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.456489 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.456721 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.456933 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.457365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.457522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.457882 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.458045 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.458200 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.458354 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.458530 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.458685 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.458838 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.459177 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.459344 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.459507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.459673 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.459839 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.459992 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.460154 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.460308 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.460473 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.460695 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.460860 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.461014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.461167 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.461321 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.461493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.461649 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.461802 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.461966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.462129 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.462283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.462445 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.462600 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.462754 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.462907 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.463078 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.463241 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.463409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.463564 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.463718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.463882 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.464043 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.464206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.464367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.464538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.464699 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.464865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.465027 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.465194 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.465359 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.465513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.465667 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.465905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.466077 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.466240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.466620 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.466788 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.466943 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.467123 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.467123 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.468218 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.468384 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.468575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.468575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.468876 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.469044 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.469390 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.469552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.469706 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.469706 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.470008 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.470008 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.470313 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.470313 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.470614 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.470779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.470942 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.471111 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.471316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.471486 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.471640 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.471793 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.471946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.472114 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.472280 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.472434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.472611 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.472778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.472949 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.473107 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.473261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.473431 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.473584 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.473754 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.473954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.474110 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.474877 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.475048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.475212 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.475367 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.475529 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.475692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.475692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.476120 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.476283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.476466 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.476862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.477057 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.477279 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.477448 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.477624 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.477780 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.478221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.478394 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.478559 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.478727 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.478891 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.479055 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.479212 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.479585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.479585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.479898 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.480053 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.480213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.480213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.480551 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.480723 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.480877 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.481043 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.481197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.481351 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.481516 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.481681 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.481836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.481989 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.482143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.482296 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.482538 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.482538 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.482843 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.483027 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.483187 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.483349 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.483514 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.483680 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.483836 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.483989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.484141 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.484304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.484466 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.484647 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.484804 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.484979 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.485143 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.485298 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.485298 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.485298 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.485745 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.485899 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.486062 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.486331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.486492 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.486655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.487089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.487496 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.487683 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.487842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.488020 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.488407 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.488600 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.488773 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.489088 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.489249 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.489420 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.489732 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.489895 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.490085 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.490250 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.490250 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.490554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.490717 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.490942 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.491099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.491262 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.491424 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.491591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.491752 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.491915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.492083 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.492238 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.492391 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.492610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.492772 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.492949 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.493109 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.493263 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.493415 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.493568 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.493739 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.496302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.496573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.496760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.496939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.497331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.497510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.497678 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.497835 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.497998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.498153 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.498358 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.498719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.498880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.499036 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.499202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.499356 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.499356 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.499665 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.499665 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.499967 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.500129 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.500300 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.500614 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.500779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.500935 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.501088 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.501242 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.501407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.501572 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.501727 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.501929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.502088 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.502250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.502415 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.503143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.503302 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.503470 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.503635 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.503796 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.503949 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.504162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.504322 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.504476 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.504683 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.504840 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.505003 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.505158 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.505359 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.505514 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.505677 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.505836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.506003 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.506169 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.506331 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.506494 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.506494 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.506891 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.507056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.507441 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.507605 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.507761 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.507915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.508077 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.508241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.508404 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.508603 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.508907 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.509065 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.509229 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.509384 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.509560 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.509719 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.509874 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.510035 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.510204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.510360 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.510543 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.510784 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.510957 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.511126 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.511289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.511449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.511612 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.511774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.511949 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.512109 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.512273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.512436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.512653 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.512823 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.512977 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.513158 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.513313 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.513483 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.513647 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.513809 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.513963 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.514132 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.514288 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.514457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.514457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.514766 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.514920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.515086 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.515253 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.515413 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.515413 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.515723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.515886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.516049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.516213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.516367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.516539 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.516717 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.516972 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.517143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.517309 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.517584 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.517753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.517914 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.518098 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.518933 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.519109 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.519273 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.519437 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.519600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.519765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.519921 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.520083 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.520252 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.520407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.520590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.520782 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.521024 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.521184 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.521338 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.521494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.521657 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.521820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.521980 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.522145 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.522299 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.522474 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.522638 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.522806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.522970 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.523124 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.523278 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.523278 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.523604 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.523769 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.523769 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.524068 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.524222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.524394 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.524597 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.524759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.524912 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.525073 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.525235 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.525399 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.525561 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.525723 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.525877 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.526037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.526191 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.526428 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.526595 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.526756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.526929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.527095 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.527256 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.527256 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.527256 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.527730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.527884 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.528044 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.528212 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.528374 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.528556 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.528730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.528988 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.529161 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.529330 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.529493 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.529647 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.529809 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.529971 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.530125 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.530288 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.530451 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.530625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.530779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.530941 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.531213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.531375 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.531537 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.531706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.531862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.532016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.532186 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.532341 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.532503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.532709 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.532887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.533043 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.533206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.533365 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.533522 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.533675 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.533857 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.534024 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.534179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.534341 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.534494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.534655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.534819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.535006 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.535692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.535866 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.536022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.536188 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.536343 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.536539 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.536713 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.536869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.536869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.537171 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.537337 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.537510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.537665 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.537818 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.537972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.538124 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.538287 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.538441 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.538599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.538760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.538927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.539189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.539367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.539541 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.539696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.539857 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.540011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.540168 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.540336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.540490 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.540710 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.540866 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.541019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.541208 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.541455 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.541623 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.541798 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.541953 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.542123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.542287 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.542450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.542604 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.542765 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.542920 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.543081 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.543245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.543407 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.543563 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.543725 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.543898 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.544053 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.544216 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.544370 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.545014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.545180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.545335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.545507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.545664 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.545902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.546071 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.546233 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.546411 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.546577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.546739 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.546902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.547056 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.547217 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.547370 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.547533 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.547689 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.547850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.548004 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.548157 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.548323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.548488 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.548677 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.548834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.548987 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.549166 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.549364 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.549524 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.549679 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.549833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.549987 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.550141 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.550309 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.550464 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.550627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.550790 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.550952 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.551114 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.551282 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.551438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.551599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.551753 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.551916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.552182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.552352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.552507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.552745 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.552901 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.553054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.553219 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.553400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.553558 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.553719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.553881 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.554036 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.554204 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.554358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.554519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.554682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.554846 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.555010 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.555163 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.555323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.555485 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.555781 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.555978 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.556165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.556332 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.556486 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.556678 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.556874 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.557054 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.557224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.557379 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.557533 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.557695 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.557857 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.558019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.558268 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.558607 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.558767 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.558921 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.559082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.559258 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 09:35:49.559422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.559422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.559422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.559422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.559422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.559422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.559422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.559422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.560625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.560625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.560625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.560625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.560625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.560625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.560625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.560625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.561814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.561814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.561814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.561814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.561814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.561814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.561814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.561814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.562993 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 09:35:49.562993 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 09:35:49.579790 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO dbcounter [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Registered counter for database nova_api Oct 27 09:35:49.588263 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO dbcounter [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Registered counter for database nova_api Oct 27 09:35:49.601301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_db.sqlalchemy.engines [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:35:49.607645 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_db.sqlalchemy.engines [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:35:49.608054 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writer thread running {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:35:49.614675 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writer thread running {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:35:49.664497 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.context [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbb9bbb7-d276-4c35-b3e7-86f2907dac7c(cell1) {{(pid=125361) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 09:35:49.668614 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:49.669028 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:49.670294 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.context [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fbb9bbb7-d276-4c35-b3e7-86f2907dac7c(cell1) {{(pid=125362) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 09:35:49.670636 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:49.671363 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:49.671810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:49.673856 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:49.674269 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:49.675276 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:49.676415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO dbcounter [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Registered counter for database nova_cell0 Oct 27 09:35:49.676889 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:49.677614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:35:49.678058 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:35:49.680154 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:35:49.680636 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO dbcounter [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Registered counter for database nova_cell1 Oct 27 09:35:49.682184 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO dbcounter [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Registered counter for database nova_cell0 Oct 27 09:35:49.686548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO dbcounter [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Registered counter for database nova_cell1 Oct 27 09:35:49.687769 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_db.sqlalchemy.engines [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:35:49.690658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_db.sqlalchemy.engines [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:35:49.694634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_db.sqlalchemy.engines [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:35:49.696411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writer thread running {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:35:49.696792 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_db.sqlalchemy.engines [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:35:49.701706 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writer thread running {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:35:49.704226 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writer thread running {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:35:49.834293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writer thread running {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:35:49.844367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO dbcounter [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Registered counter for database nova_cell0 Oct 27 09:35:49.849119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO dbcounter [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Registered counter for database nova_cell0 Oct 27 09:35:49.851094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_db.sqlalchemy.engines [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:35:49.855753 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writer thread running {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:35:49.855938 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_db.sqlalchemy.engines [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 09:35:49.860240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writer thread running {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 09:35:50.176419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: WARNING keystonemiddleware.auth_token [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:35:50.182675 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: WARNING keystonemiddleware.auth_token [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:35:50.183800 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: WARNING keystonemiddleware.auth_token [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:35:50.189945 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: WARNING keystonemiddleware.auth_token [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:35:50.528903 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: WARNING keystonemiddleware.auth_token [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:35:50.531036 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: WARNING keystonemiddleware.auth_token [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 09:35:50.535439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: WARNING keystonemiddleware.auth_token [None req-f43ce600-3362-4af3-af9f-503652c3e649 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:35:50.537722 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: WARNING keystonemiddleware.auth_token [None req-f7e1c117-e90c-47d3-b17d-b333b679cfc2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 09:35:50.540857 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555611c709c0 pid: 125361 (default app) Oct 27 09:35:50.543083 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555611c709c0 pid: 125362 (default app) Oct 27 09:36:25.695113 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=3 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:25.696076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=3 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:25.696904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=3 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:25.698194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=3 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:26.828865 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5e4d1f9c-9c47-4dbd-b572-2a7177f9a217 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Action: 'create', calling method: .version_select at 0x7f364a3d5f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1210458331"}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:28.923699 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5e4d1f9c-9c47-4dbd-b572-2a7177f9a217 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.246720 Oct 27 09:36:28.926540 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 1/1] 10.222.0.70 () {60 vars in 1155 bytes} [Thu Oct 27 09:36:25 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3251 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 09:36:28.949026 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=3 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:28.950905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=3 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:28.952807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=3 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:28.955924 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=3 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:36:29.356136 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e3a3617e-2ef9-4d43-9afc-51307bc3283e tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a3a9b80>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:29.864555 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e3a3617e-2ef9-4d43-9afc-51307bc3283e tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0" status: 200 len: 346 microversion: 2.1 time: 0.923415 Oct 27 09:36:29.865568 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 1/2] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:36:28 2022] GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 => generated 346 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:29.881630 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-15b2e88a-1df1-4835-bca9-8c1e852f51e0 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Action: 'create', calling method: .version_select at 0x7f364a23bd30>, body: {"snapshot": {"volume_id": "95420332-316b-4ca3-ac8b-eba0a68d3db0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1836924800"}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:30.310990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-15b2e88a-1df1-4835-bca9-8c1e852f51e0 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.434666 Oct 27 09:36:30.313820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 2/3] 10.222.0.70 () {60 vars in 1162 bytes} [Thu Oct 27 09:36:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:30.324761 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-73087a27-d5fd-4385-855a-b0a4e06845e5 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a276d30>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:30.388249 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-73087a27-d5fd-4385-855a-b0a4e06845e5 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24" status: 200 len: 287 microversion: 2.1 time: 0.067486 Oct 27 09:36:30.389095 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Oct 27 09:36:30 2022] GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:30.403066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ec529371-27b3-4b4c-a5ba-285abd834796 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a1d3040>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:30.475924 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ec529371-27b3-4b4c-a5ba-285abd834796 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.077914 Oct 27 09:36:30.476720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 3/5] 10.222.0.70 () {58 vars in 1140 bytes} [Thu Oct 27 09:36:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:30.504142 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-798c3c5d-ede6-4f31-b14a-7a7f8fc60f10 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a2314c0>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:30.569453 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-798c3c5d-ede6-4f31-b14a-7a7f8fc60f10 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24" status: 200 len: 287 microversion: 2.1 time: 0.082710 Oct 27 09:36:30.570716 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 3/6] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Oct 27 09:36:30 2022] GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:31.582724 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-caae7e1f-73c7-4717-b63d-26d51c2d2f36 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a1d3ca0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:31.644917 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-caae7e1f-73c7-4717-b63d-26d51c2d2f36 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24" status: 200 len: 287 microversion: 2.1 time: 0.065968 Oct 27 09:36:31.646952 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Oct 27 09:36:31 2022] GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:32.659822 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ec1939d4-27a1-4c3d-afcf-f5dd1decd1a5 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a276ca0>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:32.978603 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ec1939d4-27a1-4c3d-afcf-f5dd1decd1a5 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24" status: 200 len: 287 microversion: 2.1 time: 0.323186 Oct 27 09:36:32.979584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Oct 27 09:36:32 2022] GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24 => generated 287 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:33.991362 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0157cdad-779a-4fba-94c0-107fc08d5b17 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a1d34c0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:34.057203 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0157cdad-779a-4fba-94c0-107fc08d5b17 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24" status: 200 len: 288 microversion: 2.1 time: 0.069521 Oct 27 09:36:34.064682 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 5/9] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Oct 27 09:36:33 2022] GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24 => generated 288 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:34.069691 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-72a3d543-5d60-49f7-8387-c25fc44e4f95 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a231700>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:34.227585 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-72a3d543-5d60-49f7-8387-c25fc44e4f95 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24" status: 202 len: 0 microversion: 2.1 time: 0.161654 Oct 27 09:36:34.229313 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 5/10] 10.222.0.70 () {58 vars in 1254 bytes} [Thu Oct 27 09:36:34 2022] DELETE /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:36:34.237592 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-66a228ea-dbc0-4300-9e9a-b44d6e738505 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a1cfca0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:34.323110 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-66a228ea-dbc0-4300-9e9a-b44d6e738505 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24" status: 200 len: 287 microversion: 2.1 time: 0.089345 Oct 27 09:36:34.328659 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 6/11] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Oct 27 09:36:34 2022] GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:35.337897 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4ff3e5f4-ac36-487a-b811-b3ada1eb2c7a tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a231c10>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:35.395045 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-4ff3e5f4-ac36-487a-b811-b3ada1eb2c7a tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] HTTP exception thrown: Snapshot e0a66ac8-e00f-4b91-9b69-28563d006b24 could not be found. Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4ff3e5f4-ac36-487a-b811-b3ada1eb2c7a tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Request method failure captured: Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24 HTTP/1.1 Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEZzpZqOCU0qmxoDFgd-IIIDH_Oz3FIASVdeO2neeVe31dqwEzXHO6ptTpP78B4V5ISLSOtsAOpDnUjrqkMHYQdD6eZAtlrDo_YBR9zLB-qbA-0ru_aJfllw0rk33XgYIMyXCToH3kcSeKYwPDyBTZNvLw8TBiJ2o5tIj79Nq25-WQ Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 4e6f8f816ed2443791470c0402ed87df Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:36:35.400655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 4e6f8f816ed2443791470c0402ed87df Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-VolumesSnapshotsTestJSON-37436509-project Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: d0507f846e0a4f26bbeda8524c7fafe0 Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-VolumesSnapshotsTestJSON-37436509-project Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Snapshot e0a66ac8-e00f-4b91-9b69-28563d006b24 could not be found. Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': 'e0a66ac8-e00f-4b91-9b69-28563d006b24'} Oct 27 09:36:35.402084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e0a66ac8-e00f-4b91-9b69-28563d006b24 could not be found. (HTTP 404) (Request-ID: req-12eccf11-4132-4d69-8091-4fadbfc4f5c6) Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:35.402913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:36:35.404053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e0a66ac8-e00f-4b91-9b69-28563d006b24 could not be found. Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 27 09:36:35.405236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e0a66ac8-e00f-4b91-9b69-28563d006b24 could not be found. Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e0a66ac8-e00f-4b91-9b69-28563d006b24 could not be found. Oct 27 09:36:35.410132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:35.413221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4ff3e5f4-ac36-487a-b811-b3ada1eb2c7a tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Returning 404 to user: Snapshot e0a66ac8-e00f-4b91-9b69-28563d006b24 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:36:35.414332 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4ff3e5f4-ac36-487a-b811-b3ada1eb2c7a tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24" status: 404 len: 111 microversion: 2.1 time: 0.082359 Oct 27 09:36:35.415125 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1251 bytes} [Thu Oct 27 09:36:35 2022] GET /compute/v2.1/os-snapshots/e0a66ac8-e00f-4b91-9b69-28563d006b24 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:36:35.423255 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-48cbf53a-fadb-4826-9c27-c785b36cbd49 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a1d3430>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:35.546265 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-48cbf53a-fadb-4826-9c27-c785b36cbd49 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0" status: 202 len: 0 microversion: 2.1 time: 0.126760 Oct 27 09:36:35.547397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Oct 27 09:36:35 2022] DELETE /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:36:35.555216 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ba5211a2-f680-41bc-9d5e-bd005b2149fc tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a19c670>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:35.636119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ba5211a2-f680-41bc-9d5e-bd005b2149fc tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0" status: 200 len: 345 microversion: 2.1 time: 0.084570 Oct 27 09:36:35.636711 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 7/14] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:36:35 2022] GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:36.651298 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-84fbca4f-7d08-4b16-bb9c-cfe3b6bd27e2 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a1d3ca0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:36.757770 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-84fbca4f-7d08-4b16-bb9c-cfe3b6bd27e2 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0" status: 200 len: 345 microversion: 2.1 time: 0.110341 Oct 27 09:36:36.758320 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 8/15] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:36:36 2022] GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 => generated 345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:37.772913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-737c6e97-c84d-4a92-b23c-cc03f1fff005 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a19cd30>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:37.895475 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-737c6e97-c84d-4a92-b23c-cc03f1fff005 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0" status: 200 len: 345 microversion: 2.1 time: 0.127153 Oct 27 09:36:37.907726 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:36:37 2022] GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 => generated 345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:38.909614 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a8e61c1f-f82a-4b72-960e-b1deb606ba1d tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a1cf9d0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:39.024858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-a8e61c1f-f82a-4b72-960e-b1deb606ba1d tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] HTTP exception thrown: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a8e61c1f-f82a-4b72-960e-b1deb606ba1d tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Request method failure captured: Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 HTTP/1.1 Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEZzpZqOCU0qmxoDFgd-IIIDH_Oz3FIASVdeO2neeVe31dqwEzXHO6ptTpP78B4V5ISLSOtsAOpDnUjrqkMHYQdD6eZAtlrDo_YBR9zLB-qbA-0ru_aJfllw0rk33XgYIMyXCToH3kcSeKYwPDyBTZNvLw8TBiJ2o5tIj79Nq25-WQ Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 4e6f8f816ed2443791470c0402ed87df Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:36:39.029108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 4e6f8f816ed2443791470c0402ed87df Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-VolumesSnapshotsTestJSON-37436509-project Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: d0507f846e0a4f26bbeda8524c7fafe0 Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-VolumesSnapshotsTestJSON-37436509-project Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '95420332-316b-4ca3-ac8b-eba0a68d3db0'} Oct 27 09:36:39.030684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. (HTTP 404) (Request-ID: req-2b3ca6dc-906b-4019-b809-f699c690fa92) Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:39.031565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:36:39.032766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 09:36:39.033842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a8e61c1f-f82a-4b72-960e-b1deb606ba1d tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Returning 404 to user: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a8e61c1f-f82a-4b72-960e-b1deb606ba1d tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0" status: 404 len: 109 microversion: 2.1 time: 0.125003 Oct 27 09:36:39.034946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 9/17] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:36:38 2022] GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:36:39.043355 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-37c04f56-0592-4a62-b632-864509afc3e7 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a19cb80>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:39.151639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-37c04f56-0592-4a62-b632-864509afc3e7 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] HTTP exception thrown: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-37c04f56-0592-4a62-b632-864509afc3e7 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Request method failure captured: Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: DELETE /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 HTTP/1.1 Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEZzpZqOCU0qmxoDFgd-IIIDH_Oz3FIASVdeO2neeVe31dqwEzXHO6ptTpP78B4V5ISLSOtsAOpDnUjrqkMHYQdD6eZAtlrDo_YBR9zLB-qbA-0ru_aJfllw0rk33XgYIMyXCToH3kcSeKYwPDyBTZNvLw8TBiJ2o5tIj79Nq25-WQ Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 4e6f8f816ed2443791470c0402ed87df Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:36:39.154342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 4e6f8f816ed2443791470c0402ed87df Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-VolumesSnapshotsTestJSON-37436509-project Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: d0507f846e0a4f26bbeda8524c7fafe0 Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-VolumesSnapshotsTestJSON-37436509-project Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '95420332-316b-4ca3-ac8b-eba0a68d3db0'} Oct 27 09:36:39.155816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. (HTTP 404) (Request-ID: req-c087ef40-c226-4b94-a2d9-ab78a15e9016) Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:39.157213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:36:39.158341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 09:36:39.159430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-37c04f56-0592-4a62-b632-864509afc3e7 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Returning 404 to user: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-37c04f56-0592-4a62-b632-864509afc3e7 tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0" status: 404 len: 109 microversion: 2.1 time: 0.116248 Oct 27 09:36:39.160495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 9/18] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Oct 27 09:36:39 2022] DELETE /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:36:39.164975 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-156dbd7d-e7f5-4c85-8ee1-1b00d4a02b3f tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Calling method '.version_select at 0x7f364a1cf1f0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:39.266944 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-156dbd7d-e7f5-4c85-8ee1-1b00d4a02b3f tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] HTTP exception thrown: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-156dbd7d-e7f5-4c85-8ee1-1b00d4a02b3f tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Request method failure captured: Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 HTTP/1.1 Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEZzpZqOCU0qmxoDFgd-IIIDH_Oz3FIASVdeO2neeVe31dqwEzXHO6ptTpP78B4V5ISLSOtsAOpDnUjrqkMHYQdD6eZAtlrDo_YBR9zLB-qbA-0ru_aJfllw0rk33XgYIMyXCToH3kcSeKYwPDyBTZNvLw8TBiJ2o5tIj79Nq25-WQ Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 4e6f8f816ed2443791470c0402ed87df Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:36:39.275812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4e6f8f816ed2443791470c0402ed87df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 4e6f8f816ed2443791470c0402ed87df Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-37436509 Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-VolumesSnapshotsTestJSON-37436509-project Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: d0507f846e0a4f26bbeda8524c7fafe0 Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-VolumesSnapshotsTestJSON-37436509-project Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '95420332-316b-4ca3-ac8b-eba0a68d3db0'} Oct 27 09:36:39.277382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. (HTTP 404) (Request-ID: req-286cdb9e-472c-43a2-b63a-b13748324244) Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:39.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:36:39.279441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 09:36:39.280646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-156dbd7d-e7f5-4c85-8ee1-1b00d4a02b3f tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] Returning 404 to user: Volume 95420332-316b-4ca3-ac8b-eba0a68d3db0 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-156dbd7d-e7f5-4c85-8ee1-1b00d4a02b3f tempest-VolumesSnapshotsTestJSON-37436509 tempest-VolumesSnapshotsTestJSON-37436509-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0" status: 404 len: 109 microversion: 2.1 time: 0.116294 Oct 27 09:36:39.282405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 10/19] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:36:39 2022] GET /compute/v2.1/os-volumes/95420332-316b-4ca3-ac8b-eba0a68d3db0 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:36:40.731768 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1ecff5f0-1cb4-4b30-9160-cca041280f0d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'create', calling method: .version_select at 0x7f364a19c0d0>, body: {"keypair": {"name": "tempest-keypair-1956342945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLH6aiQhYQoG2jofRtZXc9NNqRKMeox8r6pCcTyisupBip4dyjusbJpEx8r6s0a0uBAsU+FwNptJTNWW0oIqDgBkhMk13I9X2MV0/UrrUFoxLoHKX3bKJyPiCtUqpf7D3Q=="}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:40.911553 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-1ecff5f0-1cb4-4b30-9160-cca041280f0d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Getting quotas for project 71d1c4930a1b487eb3dca8fde6ce424a. Resources: {'key_pairs'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:36:40.933058 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-1ecff5f0-1cb4-4b30-9160-cca041280f0d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Getting quotas for user 286df4c587d7408d988c4739f4ff923a and project 71d1c4930a1b487eb3dca8fde6ce424a. Resources: {'key_pairs'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:36:41.065345 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1ecff5f0-1cb4-4b30-9160-cca041280f0d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.598123 Oct 27 09:36:41.066711 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 10/20] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Oct 27 09:36:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:36:43.097567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0cdd5e59-e5e5-434a-acf6-6704d7c6c9f5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Action: 'create', calling method: .version_select at 0x7f364abbd1f0>, body: {"keypair": {"name": "tempest-keypair-1464429464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9PdRMRrOiKOaubDMIW4ZiVwcgjdsQBKVB3qcCLdssWyk6vegIGhXPNpFjY/K94kty7vI80XWOjoWYoYVsowBAkxwKIQSds78feCF9H4byCvsAzYcNrAEmANXPcA+/BxA=="}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:43.303846 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-0cdd5e59-e5e5-434a-acf6-6704d7c6c9f5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Getting quotas for project 7295248456c446bbb3f7d2d5953c9360. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:36:43.334668 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-0cdd5e59-e5e5-434a-acf6-6704d7c6c9f5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Getting quotas for user 2dea51c29cbd46e8bd1454e10eaac012 and project 7295248456c446bbb3f7d2d5953c9360. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:36:43.519418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0cdd5e59-e5e5-434a-acf6-6704d7c6c9f5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.853954 Oct 27 09:36:43.520838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 11/21] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Oct 27 09:36:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 856 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:36:45.857179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-454199574", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:46.001505 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0dd68351-a8c4-4808-8bd3-a27c8e7dbcfc tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Action: 'create', calling method: .version_select at 0x7f364a1320d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1799827513", "metadata": {"Type": "work"}}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0dd68351-a8c4-4808-8bd3-a27c8e7dbcfc tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Request method failure captured: Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 122 Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEtujAZs-bp3MBT5JGPj_Hc9KJ2oug0QeMY-RVLE57NEeGSEoNAg2PGq93HpF4r4CTcHP3sz1UzNxHYcVu8DMxMtjJLgcid0tbsZ_iDdhrpWsdlVnte9rhnwq_4_EbbGP3PtelndVo1Hq1Pnm0jIYT_WMFBbvlcewNFA0F8UvVCTDA Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:36:46.017189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 7056c7a20375483f89d5a535188a4a7b Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1799827513", "metadata": {"Type": "work"}}} Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: Oct 27 09:36:46.018519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1799827513', 'metadata': {'Type': 'work'}}}} Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi '#$%' Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:36:46.019244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:36:46.020590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:36:46.021738 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 09:36:46.021738 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.021738 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0dd68351-a8c4-4808-8bd3-a27c8e7dbcfc tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:36:46.023528 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0dd68351-a8c4-4808-8bd3-a27c8e7dbcfc tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.474010 Oct 27 09:36:46.024755 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 12/22] 10.222.0.70 () {60 vars in 1156 bytes} [Thu Oct 27 09:36:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 479 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:36:46.052307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3b56296b-6fc1-4254-a34c-65e3c5331554 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Action: 'create', calling method: .version_select at 0x7f364a0e4550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1685597331", "metadata": {"Type": "work"}}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3b56296b-6fc1-4254-a34c-65e3c5331554 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Request method failure captured: Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 120 Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEtujAZs-bp3MBT5JGPj_Hc9KJ2oug0QeMY-RVLE57NEeGSEoNAg2PGq93HpF4r4CTcHP3sz1UzNxHYcVu8DMxMtjJLgcid0tbsZ_iDdhrpWsdlVnte9rhnwq_4_EbbGP3PtelndVo1Hq1Pnm0jIYT_WMFBbvlcewNFA0F8UvVCTDA Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:36:46.068486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 7056c7a20375483f89d5a535188a4a7b Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1685597331", "metadata": {"Type": "work"}}} Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: Oct 27 09:36:46.069641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1685597331', 'metadata': {'Type': 'work'}}}} Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi '0' Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:36:46.070344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:36:46.071493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:36:46.072435 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 09:36:46.072435 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:46.073752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3b56296b-6fc1-4254-a34c-65e3c5331554 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:36:46.077084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3b56296b-6fc1-4254-a34c-65e3c5331554 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.045263 Oct 27 09:36:46.080254 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 13/23] 10.222.0.70 () {60 vars in 1156 bytes} [Thu Oct 27 09:36:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:36:46.091547 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] validate_networks() for [('778ab2d7-84d8-46e7-a293-9e88d4d9fee2', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:36:46.213088 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-841555413", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "networks": [{"uuid": "7c24dd54-2ed4-445c-a41b-4cf4e86b679d"}]}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:46.373850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.network.neutron [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] validate_networks() for [('7c24dd54-2ed4-445c-a41b-4cf4e86b679d', None, None, None, None, None)] {{(pid=125361) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:36:49.056434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:36:49.057551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:36:49.058229 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:36:49.058837 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:36:49.059508 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:36:49.102101 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:49.102935 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:49.103446 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:49.104402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:49.104991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:49.105762 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:49.167468 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Getting quotas for project df306d37ff634f7eaad80fc3bc65b653. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:36:49.174828 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Getting quotas for user 20c65ed67cd8403489949c4dea572d01 and project df306d37ff634f7eaad80fc3bc65b653. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:36:49.207788 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:36:49.216863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:36:49.326560 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Flavor limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:36:49.328094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Image limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:36:49.329283 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Flavor pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:36:49.330092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Image pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:36:49.331325 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:36:49.356969 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-01657777-28e2-4c6c-a05d-2f2e237a91a7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.081439 Oct 27 09:36:49.358573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 11/24] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:36:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 4084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:36:49.370165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-54e12b4c-6c1b-4f9e-a4bc-ff715e54a675 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Action: 'create', calling method: .version_select at 0x7f364a05f700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-608258003", "metadata": {"Type": "work"}}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:49.375593 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:49.380999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:49.381730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:49.383415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-54e12b4c-6c1b-4f9e-a4bc-ff715e54a675 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Request method failure captured: Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 118 Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEtujAZs-bp3MBT5JGPj_Hc9KJ2oug0QeMY-RVLE57NEeGSEoNAg2PGq93HpF4r4CTcHP3sz1UzNxHYcVu8DMxMtjJLgcid0tbsZ_iDdhrpWsdlVnte9rhnwq_4_EbbGP3PtelndVo1Hq1Pnm0jIYT_WMFBbvlcewNFA0F8UvVCTDA Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:36:49.384582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 7056c7a20375483f89d5a535188a4a7b Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-608258003", "metadata": {"Type": "work"}}} Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: Oct 27 09:36:49.385584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-608258003', 'metadata': {'Type': 'work'}}}} Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise error Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi '' Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:36:49.386417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 09:36:49.387405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 09:36:49.389495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 09:36:49.389495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.389495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-54e12b4c-6c1b-4f9e-a4bc-ff715e54a675 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:36:49.389495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-54e12b4c-6c1b-4f9e-a4bc-ff715e54a675 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026586 Oct 27 09:36:49.389495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 12/25] 10.222.0.70 () {60 vars in 1156 bytes} [Thu Oct 27 09:36:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:36:49.390421 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:49.392269 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:49.407995 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-662367023", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27e1c21a-a41e-4b69-8864-f162b04c2923"}], "security_groups": [{"name": "tempest-securitygroup--212276176"}], "key_name": "tempest-keypair-1956342945", "user_data": "}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:49.478578 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Getting quotas for project a417696418e34d1e9abaa74e3c5627e1. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:36:49.487960 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Getting quotas for user 6b8fa2a89eee41d09977d7c85c49707b and project a417696418e34d1e9abaa74e3c5627e1. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:36:49.504425 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Going to run 1 instances... {{(pid=125361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:36:49.508968 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:36:49.644573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f3e24beb-fad2-448d-a8e4-9dbdec90ed7a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.563136 Oct 27 09:36:49.645216 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 14/26] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:36:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:36:49.653600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d9be87a4-ed9e-4da4-9922-fa570070fcfd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:49.653600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d9be87a4-ed9e-4da4-9922-fa570070fcfd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:49.776069 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] validate_networks() for [('27e1c21a-a41e-4b69-8864-f162b04c2923', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:36:49.805018 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d9be87a4-ed9e-4da4-9922-fa570070fcfd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:49.831741 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d9be87a4-ed9e-4da4-9922-fa570070fcfd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1221 microversion: 2.1 time: 0.185313 Oct 27 09:36:49.838997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 15/27] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:49 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:49.844109 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1feeedcc-d4ce-477a-a200-43cb57f8527f tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Calling method '.version_select at 0x7f364a0f8a60>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:49.906793 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-1feeedcc-d4ce-477a-a200-43cb57f8527f tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] HTTP exception thrown: Volume tempest-invalid-845861464 could not be found. Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1feeedcc-d4ce-477a-a200-43cb57f8527f tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Request method failure captured: Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-845861464 HTTP/1.1 Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEtujAZs-bp3MBT5JGPj_Hc9KJ2oug0QeMY-RVLE57NEeGSEoNAg2PGq93HpF4r4CTcHP3sz1UzNxHYcVu8DMxMtjJLgcid0tbsZ_iDdhrpWsdlVnte9rhnwq_4_EbbGP3PtelndVo1Hq1Pnm0jIYT_WMFBbvlcewNFA0F8UvVCTDA Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:36:49.909321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 7056c7a20375483f89d5a535188a4a7b Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Volume tempest-invalid-845861464 could not be found. Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': 'tempest-invalid-845861464'} Oct 27 09:36:49.910351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-845861464 could not be found. (HTTP 404) (Request-ID: req-be959bfa-d1db-40c7-a950-3444b13b859a) Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:49.910966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:36:49.911987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-845861464 could not be found. Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:36:49.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-845861464 could not be found. Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-845861464 could not be found. Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1feeedcc-d4ce-477a-a200-43cb57f8527f tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Returning 404 to user: Volume tempest-invalid-845861464 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1feeedcc-d4ce-477a-a200-43cb57f8527f tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-845861464" status: 404 len: 98 microversion: 2.1 time: 0.070459 Oct 27 09:36:49.913829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 16/28] 10.222.0.70 () {58 vars in 1215 bytes} [Thu Oct 27 09:36:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-845861464 => generated 98 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:36:49.924424 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-428974483", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54e57d1c-1c3b-4e76-95bb-f2706c028f98"}], "security_groups": [{"name": "tempest-securitygroup--1358592857"}], "key_name": "tempest-keypair-1464429464", "user_data": "}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:50.240311 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.network.neutron [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] validate_networks() for [('54e57d1c-1c3b-4e76-95bb-f2706c028f98', None, None, None, None, None)] {{(pid=125361) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:36:51.221147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:36:51.222309 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:36:51.223082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:36:51.223743 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:36:51.224680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:36:51.241588 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:51.242534 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:51.243397 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:51.244427 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:51.245403 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:51.246323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:51.310956 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Getting quotas for project 71d1c4930a1b487eb3dca8fde6ce424a. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:36:51.323821 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Getting quotas for user 286df4c587d7408d988c4739f4ff923a and project 71d1c4930a1b487eb3dca8fde6ce424a. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:36:51.356311 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:36:51.362635 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:36:51.451141 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-85d839ba-87be-4a6b-bb33-2a7c60e2e3cc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.052726 Oct 27 09:36:51.452578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 13/29] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:36:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:36:51.483301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Flavor limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:36:51.484449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Image limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:36:51.485233 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Flavor pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:36:51.485630 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Image pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:36:51.486103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:36:51.490507 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e853f991-2ad0-4db6-a331-8123087fa171 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:51.491139 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e853f991-2ad0-4db6-a331-8123087fa171 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:51.510819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e853f991-2ad0-4db6-a331-8123087fa171 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:51.511585 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e853f991-2ad0-4db6-a331-8123087fa171 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:51.512187 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e853f991-2ad0-4db6-a331-8123087fa171 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:51.513426 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e853f991-2ad0-4db6-a331-8123087fa171 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:51.514099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e853f991-2ad0-4db6-a331-8123087fa171 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:51.515685 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e853f991-2ad0-4db6-a331-8123087fa171 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:51.522102 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:51.522690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:51.523166 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:51.524021 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:51.524560 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:51.546906 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:51.651990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Getting quotas for project 7295248456c446bbb3f7d2d5953c9360. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:36:51.665379 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Getting quotas for user 2dea51c29cbd46e8bd1454e10eaac012 and project 7295248456c446bbb3f7d2d5953c9360. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:36:51.701372 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Going to run 1 instances... {{(pid=125361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:36:51.704139 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:36:51.735901 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e853f991-2ad0-4db6-a331-8123087fa171 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:51.761442 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e853f991-2ad0-4db6-a331-8123087fa171 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1210 microversion: 2.1 time: 0.307520 Oct 27 09:36:51.768284 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 14/30] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:51 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1210 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:51.775332 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-44543aaf-e551-47a7-b0fe-421d69b8a923 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005578 Oct 27 09:36:51.781840 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 15/31] 10.222.0.70 () {58 vars in 1140 bytes} [Thu Oct 27 09:36:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 09:36:51.790863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-579620982", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:36:51.822197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a426e8e5-fbaf-4fe4-a0c5-80b06c0d406b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.902393 Oct 27 09:36:51.822965 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 17/32] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Oct 27 09:36:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:36:51.857013 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-624b405c-484b-4d07-a777-f4f0b22137f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:51.858244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-624b405c-484b-4d07-a777-f4f0b22137f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:51.922781 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] validate_networks() for [('778ab2d7-84d8-46e7-a293-9e88d4d9fee2', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:36:51.979088 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-624b405c-484b-4d07-a777-f4f0b22137f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:51.988493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-624b405c-484b-4d07-a777-f4f0b22137f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1237 microversion: 2.1 time: 0.164430 Oct 27 09:36:51.990727 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 18/33] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:51 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1237 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:51.996784 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-93fc2723-b4ac-41a3-9747-a656876d4487 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004886 Oct 27 09:36:51.997737 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 19/34] 10.222.0.70 () {58 vars in 1137 bytes} [Thu Oct 27 09:36:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 09:36:52.003193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-56e78cf6-f9a4-43a3-bc4f-d9d288f462e3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:52.004063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-56e78cf6-f9a4-43a3-bc4f-d9d288f462e3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:52.262699 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-56e78cf6-f9a4-43a3-bc4f-d9d288f462e3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:52.280326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-56e78cf6-f9a4-43a3-bc4f-d9d288f462e3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:52.281886 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-56e78cf6-f9a4-43a3-bc4f-d9d288f462e3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:52.283121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-56e78cf6-f9a4-43a3-bc4f-d9d288f462e3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1281 microversion: 2.20 time: 0.284193 Oct 27 09:36:52.299442 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 20/35] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:36:51 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1281 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:36:52.317358 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1be9b39e-aafe-4c25-9ba6-05af66469684 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Calling method '.version_select at 0x7f364a03d430>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:52.394559 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-1be9b39e-aafe-4c25-9ba6-05af66469684 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] HTTP exception thrown: Volume 0954578b-2a85-4713-adb3-72568aa22d9e could not be found. Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1be9b39e-aafe-4c25-9ba6-05af66469684 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Request method failure captured: Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: DELETE /compute/v2.1/os-volumes/0954578b-2a85-4713-adb3-72568aa22d9e HTTP/1.1 Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEtujAZs-bp3MBT5JGPj_Hc9KJ2oug0QeMY-RVLE57NEeGSEoNAg2PGq93HpF4r4CTcHP3sz1UzNxHYcVu8DMxMtjJLgcid0tbsZ_iDdhrpWsdlVnte9rhnwq_4_EbbGP3PtelndVo1Hq1Pnm0jIYT_WMFBbvlcewNFA0F8UvVCTDA Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:36:52.396957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 7056c7a20375483f89d5a535188a4a7b Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Volume 0954578b-2a85-4713-adb3-72568aa22d9e could not be found. Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '0954578b-2a85-4713-adb3-72568aa22d9e'} Oct 27 09:36:52.399241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0954578b-2a85-4713-adb3-72568aa22d9e could not be found. (HTTP 404) (Request-ID: req-fa7a1b4d-b300-4696-820b-138cf4a7ca3a) Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:52.400103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 09:36:52.401451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0954578b-2a85-4713-adb3-72568aa22d9e could not be found. Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 09:36:52.402317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0954578b-2a85-4713-adb3-72568aa22d9e could not be found. Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0954578b-2a85-4713-adb3-72568aa22d9e could not be found. Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1be9b39e-aafe-4c25-9ba6-05af66469684 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Returning 404 to user: Volume 0954578b-2a85-4713-adb3-72568aa22d9e could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:36:52.404301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1be9b39e-aafe-4c25-9ba6-05af66469684 tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/0954578b-2a85-4713-adb3-72568aa22d9e" status: 404 len: 109 microversion: 2.1 time: 0.097738 Oct 27 09:36:52.406820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 21/36] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Oct 27 09:36:52 2022] DELETE /compute/v2.1/os-volumes/0954578b-2a85-4713-adb3-72568aa22d9e => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:36:52.420954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-93729ce0-4109-45de-b582-141a00c0282a tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Calling method '.version_select at 0x7f364a023b80>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:52.535920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-93729ce0-4109-45de-b582-141a00c0282a tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] HTTP exception thrown: Volume 7fc71e9e-bc79-4e50-80af-6e6a8d074c4d could not be found. Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-93729ce0-4109-45de-b582-141a00c0282a tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Request method failure captured: Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/os-volumes/7fc71e9e-bc79-4e50-80af-6e6a8d074c4d HTTP/1.1 Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEtujAZs-bp3MBT5JGPj_Hc9KJ2oug0QeMY-RVLE57NEeGSEoNAg2PGq93HpF4r4CTcHP3sz1UzNxHYcVu8DMxMtjJLgcid0tbsZ_iDdhrpWsdlVnte9rhnwq_4_EbbGP3PtelndVo1Hq1Pnm0jIYT_WMFBbvlcewNFA0F8UvVCTDA Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:36:52.538058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c393eb39d1ca42aa879756bb8d7ec4e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: c393eb39d1ca42aa879756bb8d7ec4e3 Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-VolumesNegativeTest-36356289 Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 7056c7a20375483f89d5a535188a4a7b Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-VolumesNegativeTest-36356289-project Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Volume 7fc71e9e-bc79-4e50-80af-6e6a8d074c4d could not be found. Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '7fc71e9e-bc79-4e50-80af-6e6a8d074c4d'} Oct 27 09:36:52.539103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7fc71e9e-bc79-4e50-80af-6e6a8d074c4d could not be found. (HTTP 404) (Request-ID: req-b93bdefb-a271-4d19-9c33-0c834694c96e) Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:52.540207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:36:52.541194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7fc71e9e-bc79-4e50-80af-6e6a8d074c4d could not be found. Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 09:36:52.542512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7fc71e9e-bc79-4e50-80af-6e6a8d074c4d could not be found. Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7fc71e9e-bc79-4e50-80af-6e6a8d074c4d could not be found. Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-93729ce0-4109-45de-b582-141a00c0282a tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] Returning 404 to user: Volume 7fc71e9e-bc79-4e50-80af-6e6a8d074c4d could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:36:52.543827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-93729ce0-4109-45de-b582-141a00c0282a tempest-VolumesNegativeTest-36356289 tempest-VolumesNegativeTest-36356289-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/7fc71e9e-bc79-4e50-80af-6e6a8d074c4d" status: 404 len: 109 microversion: 2.1 time: 0.133584 Oct 27 09:36:52.550677 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 22/37] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:36:52 2022] GET /compute/v2.1/os-volumes/7fc71e9e-bc79-4e50-80af-6e6a8d074c4d => generated 109 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:36:52.790410 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c874a528-16a7-4dc3-a4e7-b99c155aeaa4 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:52.791025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c874a528-16a7-4dc3-a4e7-b99c155aeaa4 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:52.798562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c874a528-16a7-4dc3-a4e7-b99c155aeaa4 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:52.799023 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c874a528-16a7-4dc3-a4e7-b99c155aeaa4 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:52.808161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c874a528-16a7-4dc3-a4e7-b99c155aeaa4 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:52.810483 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c874a528-16a7-4dc3-a4e7-b99c155aeaa4 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:52.828925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c874a528-16a7-4dc3-a4e7-b99c155aeaa4 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:52.829676 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c874a528-16a7-4dc3-a4e7-b99c155aeaa4 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:53.504961 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c874a528-16a7-4dc3-a4e7-b99c155aeaa4 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:53.543378 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c874a528-16a7-4dc3-a4e7-b99c155aeaa4 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1274 microversion: 2.1 time: 0.752977 Oct 27 09:36:53.547592 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 23/38] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:52 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1274 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:53.564990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-053fa14c-e051-4ffc-a009-bc2fa87e361b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:53.566688 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-053fa14c-e051-4ffc-a009-bc2fa87e361b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:53.595473 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-053fa14c-e051-4ffc-a009-bc2fa87e361b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:53.596460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-053fa14c-e051-4ffc-a009-bc2fa87e361b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:53.597476 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-053fa14c-e051-4ffc-a009-bc2fa87e361b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:53.602016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-053fa14c-e051-4ffc-a009-bc2fa87e361b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:53.603275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-053fa14c-e051-4ffc-a009-bc2fa87e361b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:53.603905 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-053fa14c-e051-4ffc-a009-bc2fa87e361b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:53.610973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:36:53.612176 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:36:53.612838 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:36:53.613420 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:36:53.613989 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:36:53.645564 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:53.647531 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:53.648018 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:53.653403 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:53.653885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:53.654770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:53.758497 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Getting quotas for project df306d37ff634f7eaad80fc3bc65b653. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:36:53.769770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Getting quotas for user 20c65ed67cd8403489949c4dea572d01 and project df306d37ff634f7eaad80fc3bc65b653. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:36:53.777044 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-053fa14c-e051-4ffc-a009-bc2fa87e361b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:53.785854 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-053fa14c-e051-4ffc-a009-bc2fa87e361b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1289 microversion: 2.1 time: 0.236501 Oct 27 09:36:53.789873 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 24/39] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:53 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1289 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:53.796243 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:53.797189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:53.803633 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:53.804391 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:53.805406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:53.806833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:53.807491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:53.808143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:53.809605 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:36:53.815145 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:36:53.886685 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-85c15b17-facb-4f3c-b339-ee81a754e76a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.103531 Oct 27 09:36:53.898770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 16/40] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:36:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:36:53.905212 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-19c93805-c9ed-490e-9629-3ecff7618868 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:53.907407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-19c93805-c9ed-490e-9629-3ecff7618868 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:53.965015 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:53.987754 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:54.010905 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:54.013168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-bd3e3241-bfe1-4ad0-a2e2-cc41b12f106f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1277 microversion: 2.20 time: 0.222051 Oct 27 09:36:54.017870 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 25/41] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:36:53 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:36:54.130698 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-19c93805-c9ed-490e-9629-3ecff7618868 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:54.176633 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-19c93805-c9ed-490e-9629-3ecff7618868 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1221 microversion: 2.1 time: 0.275417 Oct 27 09:36:54.195239 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 17/42] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:53 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1221 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:54.575239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-dda7c16b-a565-4a4a-a250-97ef8ca44c44 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:54.576554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-dda7c16b-a565-4a4a-a250-97ef8ca44c44 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:54.592653 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dda7c16b-a565-4a4a-a250-97ef8ca44c44 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:54.593572 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dda7c16b-a565-4a4a-a250-97ef8ca44c44 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:54.595455 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dda7c16b-a565-4a4a-a250-97ef8ca44c44 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:54.597321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dda7c16b-a565-4a4a-a250-97ef8ca44c44 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:54.598148 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dda7c16b-a565-4a4a-a250-97ef8ca44c44 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:54.599284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dda7c16b-a565-4a4a-a250-97ef8ca44c44 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:54.810131 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-dda7c16b-a565-4a4a-a250-97ef8ca44c44 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:54.814427 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-acb3f7fd-a9c3-42f5-b45f-e69b297fc818 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:54.815170 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-acb3f7fd-a9c3-42f5-b45f-e69b297fc818 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:54.839415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-dda7c16b-a565-4a4a-a250-97ef8ca44c44 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1272 microversion: 2.1 time: 0.267987 Oct 27 09:36:54.844094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 26/43] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:54 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:54.845137 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acb3f7fd-a9c3-42f5-b45f-e69b297fc818 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:54.845799 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acb3f7fd-a9c3-42f5-b45f-e69b297fc818 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:54.846239 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acb3f7fd-a9c3-42f5-b45f-e69b297fc818 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:54.846983 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acb3f7fd-a9c3-42f5-b45f-e69b297fc818 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:54.847435 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acb3f7fd-a9c3-42f5-b45f-e69b297fc818 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:54.847859 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acb3f7fd-a9c3-42f5-b45f-e69b297fc818 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:55.014249 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-acb3f7fd-a9c3-42f5-b45f-e69b297fc818 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:55.040139 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-acb3f7fd-a9c3-42f5-b45f-e69b297fc818 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1295 microversion: 2.1 time: 0.233497 Oct 27 09:36:55.043225 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 18/44] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:54 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1295 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:55.069392 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:55.070424 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:55.092132 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:55.092657 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:55.103005 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:55.103881 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:55.104378 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:55.104852 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:55.203476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a6d691bf-8357-45c9-92a6-07d656acf07d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:55.205316 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a6d691bf-8357-45c9-92a6-07d656acf07d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:55.777856 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:55.787518 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:55.803310 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:55.809373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-bb569554-4a34-43eb-831e-a500e18eb38b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1333 microversion: 2.20 time: 0.762253 Oct 27 09:36:55.810004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 27/45] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:36:55 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1333 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:36:55.838291 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a6d691bf-8357-45c9-92a6-07d656acf07d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:55.849295 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a6d691bf-8357-45c9-92a6-07d656acf07d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1221 microversion: 2.1 time: 0.651110 Oct 27 09:36:55.882459 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b42dba30-d8a9-4df0-9ac0-14f299ceb9cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:55.883088 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b42dba30-d8a9-4df0-9ac0-14f299ceb9cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:55.890064 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 19/46] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:55 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1221 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:55.897703 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b42dba30-d8a9-4df0-9ac0-14f299ceb9cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:55.899771 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b42dba30-d8a9-4df0-9ac0-14f299ceb9cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:55.901798 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b42dba30-d8a9-4df0-9ac0-14f299ceb9cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:55.903014 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b42dba30-d8a9-4df0-9ac0-14f299ceb9cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:55.907220 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b42dba30-d8a9-4df0-9ac0-14f299ceb9cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:55.907976 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b42dba30-d8a9-4df0-9ac0-14f299ceb9cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:56.080500 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a6a11b21-5442-49eb-bca5-a7f8e6e9f021 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:56.081524 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a6a11b21-5442-49eb-bca5-a7f8e6e9f021 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:56.108330 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a6a11b21-5442-49eb-bca5-a7f8e6e9f021 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:56.109076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a6a11b21-5442-49eb-bca5-a7f8e6e9f021 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:56.109678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a6a11b21-5442-49eb-bca5-a7f8e6e9f021 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:56.110419 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a6a11b21-5442-49eb-bca5-a7f8e6e9f021 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:56.110883 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a6a11b21-5442-49eb-bca5-a7f8e6e9f021 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:56.111310 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a6a11b21-5442-49eb-bca5-a7f8e6e9f021 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:56.283169 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b42dba30-d8a9-4df0-9ac0-14f299ceb9cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:56.317663 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b42dba30-d8a9-4df0-9ac0-14f299ceb9cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1272 microversion: 2.1 time: 0.436792 Oct 27 09:36:56.320034 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 28/47] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:55 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1272 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:56.385816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a6a11b21-5442-49eb-bca5-a7f8e6e9f021 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:56.400609 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a6a11b21-5442-49eb-bca5-a7f8e6e9f021 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1295 microversion: 2.1 time: 0.325731 Oct 27 09:36:56.402445 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 20/48] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:56 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1295 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:56.843618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:56.845569 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:56.862768 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:56.864221 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:56.865245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:56.866399 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:56.867776 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:56.871782 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:56.888415 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0a060328-db98-4592-9d70-d3ed8570b0f0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:56.890149 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0a060328-db98-4592-9d70-d3ed8570b0f0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:56.907792 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a060328-db98-4592-9d70-d3ed8570b0f0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:56.909463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a060328-db98-4592-9d70-d3ed8570b0f0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:56.911929 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a060328-db98-4592-9d70-d3ed8570b0f0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:56.913585 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a060328-db98-4592-9d70-d3ed8570b0f0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:56.915830 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a060328-db98-4592-9d70-d3ed8570b0f0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:56.917942 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a060328-db98-4592-9d70-d3ed8570b0f0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:57.172820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:57.182193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:57.187163 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:57.188583 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-beaa1a7f-ac61-47de-bd91-ce33299dcbf6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1339 microversion: 2.20 time: 0.350510 Oct 27 09:36:57.191894 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 29/49] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:36:56 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1339 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:36:57.344888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0a060328-db98-4592-9d70-d3ed8570b0f0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:57.348418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9e903a08-a768-4c41-9d20-5e481bbca063 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:57.349232 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9e903a08-a768-4c41-9d20-5e481bbca063 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:57.357672 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0a060328-db98-4592-9d70-d3ed8570b0f0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1273 microversion: 2.1 time: 0.473959 Oct 27 09:36:57.359406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e903a08-a768-4c41-9d20-5e481bbca063 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:57.360651 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 21/50] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:56 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1273 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:57.366042 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e903a08-a768-4c41-9d20-5e481bbca063 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:57.367434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e903a08-a768-4c41-9d20-5e481bbca063 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:57.368425 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e903a08-a768-4c41-9d20-5e481bbca063 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:57.369166 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e903a08-a768-4c41-9d20-5e481bbca063 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:57.369827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e903a08-a768-4c41-9d20-5e481bbca063 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:57.426659 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9324ffcd-6f01-41cb-93da-8bcb5886afa6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:57.427355 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9324ffcd-6f01-41cb-93da-8bcb5886afa6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:57.448786 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9324ffcd-6f01-41cb-93da-8bcb5886afa6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:57.449762 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9324ffcd-6f01-41cb-93da-8bcb5886afa6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:57.451349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9324ffcd-6f01-41cb-93da-8bcb5886afa6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:57.453402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9324ffcd-6f01-41cb-93da-8bcb5886afa6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:57.463172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9324ffcd-6f01-41cb-93da-8bcb5886afa6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:57.466168 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9324ffcd-6f01-41cb-93da-8bcb5886afa6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:57.981337 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9324ffcd-6f01-41cb-93da-8bcb5886afa6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:57.997897 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9324ffcd-6f01-41cb-93da-8bcb5886afa6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.575044 Oct 27 09:36:58.013632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 22/51] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:57 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:58.072097 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9e903a08-a768-4c41-9d20-5e481bbca063 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:58.085084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9e903a08-a768-4c41-9d20-5e481bbca063 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.742151 Oct 27 09:36:58.086225 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 30/52] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:57 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:36:58.218837 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:58.219528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:58.226876 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:58.227800 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:58.228317 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:58.229592 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:58.230132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:58.230633 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:58.313371 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:58.325187 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:58.327428 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:58.328863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f9d2840f-5d8f-4cad-8f5a-39aa30009ea5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1339 microversion: 2.20 time: 0.116362 Oct 27 09:36:58.330122 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 23/53] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:36:58 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1339 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:36:58.383015 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7d23c40d-12c4-42a7-8b0d-bb1443586b6a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:58.383625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7d23c40d-12c4-42a7-8b0d-bb1443586b6a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:58.393230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d23c40d-12c4-42a7-8b0d-bb1443586b6a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:58.394219 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d23c40d-12c4-42a7-8b0d-bb1443586b6a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:58.394836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d23c40d-12c4-42a7-8b0d-bb1443586b6a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:58.396194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d23c40d-12c4-42a7-8b0d-bb1443586b6a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:58.397065 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d23c40d-12c4-42a7-8b0d-bb1443586b6a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:58.397644 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d23c40d-12c4-42a7-8b0d-bb1443586b6a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:58.487554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7d23c40d-12c4-42a7-8b0d-bb1443586b6a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:58.495903 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7d23c40d-12c4-42a7-8b0d-bb1443586b6a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1273 microversion: 2.1 time: 0.116821 Oct 27 09:36:58.496746 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 31/54] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:58 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:59.025203 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-396756e3-1e90-4f11-bee4-41362aea0f37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:59.025887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-396756e3-1e90-4f11-bee4-41362aea0f37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:59.033508 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-396756e3-1e90-4f11-bee4-41362aea0f37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:59.034198 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-396756e3-1e90-4f11-bee4-41362aea0f37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:59.035015 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-396756e3-1e90-4f11-bee4-41362aea0f37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:59.036017 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-396756e3-1e90-4f11-bee4-41362aea0f37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:59.036479 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-396756e3-1e90-4f11-bee4-41362aea0f37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:59.037074 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-396756e3-1e90-4f11-bee4-41362aea0f37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:59.111756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-55e8b3f1-aea7-479a-9e96-1db50ea56367 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:59.112275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-55e8b3f1-aea7-479a-9e96-1db50ea56367 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:59.121048 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-55e8b3f1-aea7-479a-9e96-1db50ea56367 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:59.121542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-55e8b3f1-aea7-479a-9e96-1db50ea56367 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:59.121970 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-55e8b3f1-aea7-479a-9e96-1db50ea56367 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:59.122682 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-55e8b3f1-aea7-479a-9e96-1db50ea56367 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:59.123428 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-55e8b3f1-aea7-479a-9e96-1db50ea56367 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:59.123855 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-55e8b3f1-aea7-479a-9e96-1db50ea56367 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:59.253706 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-396756e3-1e90-4f11-bee4-41362aea0f37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:59.261770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-396756e3-1e90-4f11-bee4-41362aea0f37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.240346 Oct 27 09:36:59.278605 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 24/55] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:59 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:36:59.335575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-55e8b3f1-aea7-479a-9e96-1db50ea56367 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:59.344596 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-55e8b3f1-aea7-479a-9e96-1db50ea56367 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.236940 Oct 27 09:36:59.345369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 32/56] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:59 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:36:59.355447 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:59.356264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:59.362362 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:59.362861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:59.363383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:59.364182 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:59.364749 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:59.365244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:59.487469 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:59.497127 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:59.499487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:59.500919 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ee0cebdf-99c3-42ba-9397-1cfe94ef7017 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1339 microversion: 2.20 time: 0.149484 Oct 27 09:36:59.517186 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 25/57] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:36:59 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1339 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:36:59.521383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b0071bcf-441b-4b77-905c-26f3a83b2bd3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:36:59.522066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b0071bcf-441b-4b77-905c-26f3a83b2bd3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:36:59.538078 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b0071bcf-441b-4b77-905c-26f3a83b2bd3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:59.538815 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b0071bcf-441b-4b77-905c-26f3a83b2bd3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:59.540573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b0071bcf-441b-4b77-905c-26f3a83b2bd3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:59.543253 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b0071bcf-441b-4b77-905c-26f3a83b2bd3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:36:59.544789 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b0071bcf-441b-4b77-905c-26f3a83b2bd3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:36:59.545240 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b0071bcf-441b-4b77-905c-26f3a83b2bd3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:36:59.640910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b0071bcf-441b-4b77-905c-26f3a83b2bd3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:36:59.650080 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b0071bcf-441b-4b77-905c-26f3a83b2bd3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1281 microversion: 2.1 time: 0.134285 Oct 27 09:36:59.654529 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 33/58] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:36:59 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:00.286467 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-cf3a5e56-0260-46a5-9a81-d401dc734653 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:00.287758 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-cf3a5e56-0260-46a5-9a81-d401dc734653 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:00.296764 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf3a5e56-0260-46a5-9a81-d401dc734653 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:00.309730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf3a5e56-0260-46a5-9a81-d401dc734653 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:00.312629 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf3a5e56-0260-46a5-9a81-d401dc734653 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:00.313621 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf3a5e56-0260-46a5-9a81-d401dc734653 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:00.314107 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf3a5e56-0260-46a5-9a81-d401dc734653 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:00.314532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf3a5e56-0260-46a5-9a81-d401dc734653 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:00.368850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7e67b460-7954-4c6d-b6f5-3cec40ea0387 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:00.369981 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7e67b460-7954-4c6d-b6f5-3cec40ea0387 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:00.379930 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7e67b460-7954-4c6d-b6f5-3cec40ea0387 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:00.380419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7e67b460-7954-4c6d-b6f5-3cec40ea0387 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:00.381655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7e67b460-7954-4c6d-b6f5-3cec40ea0387 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:00.382537 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7e67b460-7954-4c6d-b6f5-3cec40ea0387 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:00.382939 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7e67b460-7954-4c6d-b6f5-3cec40ea0387 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:00.389246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7e67b460-7954-4c6d-b6f5-3cec40ea0387 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:00.789571 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cf3a5e56-0260-46a5-9a81-d401dc734653 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:00.800885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-cf3a5e56-0260-46a5-9a81-d401dc734653 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.518723 Oct 27 09:37:00.808186 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7e67b460-7954-4c6d-b6f5-3cec40ea0387 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:00.817326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7e67b460-7954-4c6d-b6f5-3cec40ea0387 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.453684 Oct 27 09:37:00.817846 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 26/59] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:00 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:00.819957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 34/60] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:00 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:00.830540 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-664fdc01-9656-4780-a983-0f4031d18abd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:00.831538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:00.832326 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:00.833140 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-664fdc01-9656-4780-a983-0f4031d18abd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:00.846490 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:00.848147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:00.849031 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-664fdc01-9656-4780-a983-0f4031d18abd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:00.849225 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:00.850168 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:00.850623 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:00.851039 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:00.851659 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-664fdc01-9656-4780-a983-0f4031d18abd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:00.852277 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-664fdc01-9656-4780-a983-0f4031d18abd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:00.853182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-664fdc01-9656-4780-a983-0f4031d18abd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:00.855245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-664fdc01-9656-4780-a983-0f4031d18abd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:00.856303 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-664fdc01-9656-4780-a983-0f4031d18abd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:00.985739 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:01.020086 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:01.026747 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:01.028997 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-88da253a-ca60-4945-a877-e6b5c10a7438 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1339 microversion: 2.20 time: 0.208973 Oct 27 09:37:01.032212 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 27/61] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:00 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:01.033612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-664fdc01-9656-4780-a983-0f4031d18abd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:01.053541 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-664fdc01-9656-4780-a983-0f4031d18abd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1281 microversion: 2.1 time: 0.230513 Oct 27 09:37:01.057195 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 35/62] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:00 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1281 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:01.837915 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7536d6fd-508a-4169-a26a-2b81167f8d45 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:01.839795 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7536d6fd-508a-4169-a26a-2b81167f8d45 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:01.847494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7536d6fd-508a-4169-a26a-2b81167f8d45 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:01.848221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7536d6fd-508a-4169-a26a-2b81167f8d45 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:01.848929 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7536d6fd-508a-4169-a26a-2b81167f8d45 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:01.850080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7536d6fd-508a-4169-a26a-2b81167f8d45 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:01.851453 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7536d6fd-508a-4169-a26a-2b81167f8d45 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:01.852359 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7536d6fd-508a-4169-a26a-2b81167f8d45 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:01.873244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b96408c3-7704-41b7-a76d-8ffb715cb1d8 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:01.874468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b96408c3-7704-41b7-a76d-8ffb715cb1d8 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:01.877613 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=4 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:01.884290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b96408c3-7704-41b7-a76d-8ffb715cb1d8 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:01.888939 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b96408c3-7704-41b7-a76d-8ffb715cb1d8 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:01.889463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b96408c3-7704-41b7-a76d-8ffb715cb1d8 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:01.891457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b96408c3-7704-41b7-a76d-8ffb715cb1d8 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:01.892105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b96408c3-7704-41b7-a76d-8ffb715cb1d8 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:01.895620 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b96408c3-7704-41b7-a76d-8ffb715cb1d8 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:02.085493 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7536d6fd-508a-4169-a26a-2b81167f8d45 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:02.093753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7536d6fd-508a-4169-a26a-2b81167f8d45 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.259786 Oct 27 09:37:02.100503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 28/63] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:01 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:02.105555 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:02.112436 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:02.122568 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:02.123302 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:02.125625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:02.129512 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:02.136051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:02.136865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:02.156019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b96408c3-7704-41b7-a76d-8ffb715cb1d8 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:02.166457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b96408c3-7704-41b7-a76d-8ffb715cb1d8 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.297400 Oct 27 09:37:02.167388 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 36/64] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:01 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:02.175056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-de529d68-56d4-4cd4-92bb-40e4c73f630c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:02.175968 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-de529d68-56d4-4cd4-92bb-40e4c73f630c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:02.195521 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de529d68-56d4-4cd4-92bb-40e4c73f630c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:02.199785 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de529d68-56d4-4cd4-92bb-40e4c73f630c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:02.200237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de529d68-56d4-4cd4-92bb-40e4c73f630c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:02.201194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de529d68-56d4-4cd4-92bb-40e4c73f630c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:02.201867 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de529d68-56d4-4cd4-92bb-40e4c73f630c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:02.202323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de529d68-56d4-4cd4-92bb-40e4c73f630c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:02.239533 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:02.249710 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:02.256052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:02.257323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-40faaa3f-5e99-4126-a340-91cd7ed96afa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1339 microversion: 2.20 time: 0.155531 Oct 27 09:37:02.262475 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 29/65] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:02 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1339 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:02.272632 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=22 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:02.296456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-de529d68-56d4-4cd4-92bb-40e4c73f630c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:02.305599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-de529d68-56d4-4cd4-92bb-40e4c73f630c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1281 microversion: 2.1 time: 0.135113 Oct 27 09:37:02.306398 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 37/66] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:02 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:03.126040 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-80b40fbf-e85c-4591-9d0b-33cd5a783341 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:03.126775 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-80b40fbf-e85c-4591-9d0b-33cd5a783341 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:03.138954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b40fbf-e85c-4591-9d0b-33cd5a783341 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:03.140943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b40fbf-e85c-4591-9d0b-33cd5a783341 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:03.141401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b40fbf-e85c-4591-9d0b-33cd5a783341 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:03.145377 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b40fbf-e85c-4591-9d0b-33cd5a783341 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:03.146315 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b40fbf-e85c-4591-9d0b-33cd5a783341 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:03.146754 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b40fbf-e85c-4591-9d0b-33cd5a783341 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:03.191471 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-367baee4-b6a1-4b85-9950-0b489883ece0 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:03.193580 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-367baee4-b6a1-4b85-9950-0b489883ece0 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:03.206337 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-367baee4-b6a1-4b85-9950-0b489883ece0 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:03.207143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-367baee4-b6a1-4b85-9950-0b489883ece0 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:03.209112 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-367baee4-b6a1-4b85-9950-0b489883ece0 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:03.210020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-367baee4-b6a1-4b85-9950-0b489883ece0 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:03.210670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-367baee4-b6a1-4b85-9950-0b489883ece0 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:03.211312 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-367baee4-b6a1-4b85-9950-0b489883ece0 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:03.528800 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-367baee4-b6a1-4b85-9950-0b489883ece0 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:03.535245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:03.540587 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-367baee4-b6a1-4b85-9950-0b489883ece0 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.353028 Oct 27 09:37:03.541371 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 38/67] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:03 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:03.547766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:03.548752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:03.553907 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-80b40fbf-e85c-4591-9d0b-33cd5a783341 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:03.565249 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:03.565249 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:03.565249 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:03.565249 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:03.565654 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:03.565654 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:03.571127 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-80b40fbf-e85c-4591-9d0b-33cd5a783341 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.451103 Oct 27 09:37:03.571792 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 30/68] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:03 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:03.577970 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-300b4fa7-9935-485e-afde-fbb575e04588 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:03.578826 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-300b4fa7-9935-485e-afde-fbb575e04588 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:03.586193 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-300b4fa7-9935-485e-afde-fbb575e04588 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:03.587214 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-300b4fa7-9935-485e-afde-fbb575e04588 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:03.587884 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-300b4fa7-9935-485e-afde-fbb575e04588 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:03.588867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-300b4fa7-9935-485e-afde-fbb575e04588 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:03.589546 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-300b4fa7-9935-485e-afde-fbb575e04588 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:03.590188 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-300b4fa7-9935-485e-afde-fbb575e04588 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:03.709266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-300b4fa7-9935-485e-afde-fbb575e04588 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:03.715704 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=6 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:03.724973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-300b4fa7-9935-485e-afde-fbb575e04588 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1281 microversion: 2.1 time: 0.151374 Oct 27 09:37:03.726257 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 31/69] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:03 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:03.767942 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:03.779244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:03.781396 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:03.782897 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-02a1792c-7632-48e4-805d-cf9e5a3f7837 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1339 microversion: 2.20 time: 0.240285 Oct 27 09:37:03.797277 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 39/70] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:03 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1339 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:04.570338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9697ca9a-1b78-4609-88fc-6581f4a5a4cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:04.571395 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9697ca9a-1b78-4609-88fc-6581f4a5a4cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:04.581303 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:04.583122 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9697ca9a-1b78-4609-88fc-6581f4a5a4cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:04.584981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9697ca9a-1b78-4609-88fc-6581f4a5a4cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:04.589169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9697ca9a-1b78-4609-88fc-6581f4a5a4cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:04.590541 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9697ca9a-1b78-4609-88fc-6581f4a5a4cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:04.591776 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9697ca9a-1b78-4609-88fc-6581f4a5a4cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:04.593525 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9697ca9a-1b78-4609-88fc-6581f4a5a4cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:04.602691 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-06e5a282-fba2-4681-8c19-3851ccbc4d94 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:04.603373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-06e5a282-fba2-4681-8c19-3851ccbc4d94 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:04.614001 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-06e5a282-fba2-4681-8c19-3851ccbc4d94 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:04.616243 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-06e5a282-fba2-4681-8c19-3851ccbc4d94 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:04.616910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-06e5a282-fba2-4681-8c19-3851ccbc4d94 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:04.621474 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-06e5a282-fba2-4681-8c19-3851ccbc4d94 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:04.622144 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-06e5a282-fba2-4681-8c19-3851ccbc4d94 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:04.622577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-06e5a282-fba2-4681-8c19-3851ccbc4d94 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:05.046444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9697ca9a-1b78-4609-88fc-6581f4a5a4cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:05.057975 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9697ca9a-1b78-4609-88fc-6581f4a5a4cf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.492405 Oct 27 09:37:05.067256 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 32/71] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:04 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:05.084763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4b65c94c-cc68-4411-a3f2-a7fd8f88ab76 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:05.085771 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4b65c94c-cc68-4411-a3f2-a7fd8f88ab76 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:05.095658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-06e5a282-fba2-4681-8c19-3851ccbc4d94 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:05.100845 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b65c94c-cc68-4411-a3f2-a7fd8f88ab76 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:05.103028 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b65c94c-cc68-4411-a3f2-a7fd8f88ab76 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:05.103590 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b65c94c-cc68-4411-a3f2-a7fd8f88ab76 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:05.104709 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b65c94c-cc68-4411-a3f2-a7fd8f88ab76 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:05.105362 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b65c94c-cc68-4411-a3f2-a7fd8f88ab76 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:05.105877 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b65c94c-cc68-4411-a3f2-a7fd8f88ab76 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:05.111487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-06e5a282-fba2-4681-8c19-3851ccbc4d94 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.512735 Oct 27 09:37:05.123370 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 40/72] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:04 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:05.134257 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:05.134863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:05.141662 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:05.142411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:05.142999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:05.143858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:05.144456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:05.145040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:05.159888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:05.346675 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4b65c94c-cc68-4411-a3f2-a7fd8f88ab76 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:05.361308 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4b65c94c-cc68-4411-a3f2-a7fd8f88ab76 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1281 microversion: 2.1 time: 0.290889 Oct 27 09:37:05.362191 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 33/73] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:05 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1281 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:05.382839 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:05.392148 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:05.401098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:05.402461 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ad91935a-7992-4135-8e18-eb2ce16f8e4c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1339 microversion: 2.20 time: 0.277991 Oct 27 09:37:05.403625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 41/74] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:05 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1339 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:06.098281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-79029b4c-38b1-47ae-a3bb-01cff1442679 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:06.099510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-79029b4c-38b1-47ae-a3bb-01cff1442679 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:06.107740 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=26 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:06.111147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79029b4c-38b1-47ae-a3bb-01cff1442679 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:06.114067 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79029b4c-38b1-47ae-a3bb-01cff1442679 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:06.114513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79029b4c-38b1-47ae-a3bb-01cff1442679 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:06.115236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79029b4c-38b1-47ae-a3bb-01cff1442679 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:06.115693 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79029b4c-38b1-47ae-a3bb-01cff1442679 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:06.116108 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79029b4c-38b1-47ae-a3bb-01cff1442679 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:06.139853 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-10723dfe-c65b-42cc-a1b9-a51f03d230e2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:06.141364 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-10723dfe-c65b-42cc-a1b9-a51f03d230e2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:06.164198 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10723dfe-c65b-42cc-a1b9-a51f03d230e2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:06.165317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10723dfe-c65b-42cc-a1b9-a51f03d230e2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:06.165761 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10723dfe-c65b-42cc-a1b9-a51f03d230e2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:06.166479 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10723dfe-c65b-42cc-a1b9-a51f03d230e2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:06.173354 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10723dfe-c65b-42cc-a1b9-a51f03d230e2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:06.173997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10723dfe-c65b-42cc-a1b9-a51f03d230e2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:06.429605 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-79029b4c-38b1-47ae-a3bb-01cff1442679 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:06.438160 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-79029b4c-38b1-47ae-a3bb-01cff1442679 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.343825 Oct 27 09:37:06.439409 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 34/75] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:06 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:06.460270 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-adfc7d24-d178-4bcc-a6cb-77849f2becf9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:06.469848 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-adfc7d24-d178-4bcc-a6cb-77849f2becf9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:06.480810 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-adfc7d24-d178-4bcc-a6cb-77849f2becf9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:06.483965 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-adfc7d24-d178-4bcc-a6cb-77849f2becf9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:06.485785 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-adfc7d24-d178-4bcc-a6cb-77849f2becf9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:06.486803 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-adfc7d24-d178-4bcc-a6cb-77849f2becf9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:06.488816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-adfc7d24-d178-4bcc-a6cb-77849f2becf9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:06.490150 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-adfc7d24-d178-4bcc-a6cb-77849f2becf9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:06.510031 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-10723dfe-c65b-42cc-a1b9-a51f03d230e2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:06.522882 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-10723dfe-c65b-42cc-a1b9-a51f03d230e2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.387516 Oct 27 09:37:06.525067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 42/76] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:06 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:06.548620 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:06.557361 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:06.571727 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:06.573519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:06.574234 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:06.575063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:06.576373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:06.580237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:06.581287 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:06.693728 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-adfc7d24-d178-4bcc-a6cb-77849f2becf9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:06.704173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-adfc7d24-d178-4bcc-a6cb-77849f2becf9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1281 microversion: 2.1 time: 0.263438 Oct 27 09:37:06.712021 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 35/77] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:06 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1281 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:06.762002 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:06.774160 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:06.776007 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:06.777954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9c2cb6bb-5dec-4588-a099-b887246634fa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1339 microversion: 2.20 time: 0.251652 Oct 27 09:37:06.793100 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 43/78] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:06 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1339 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:07.471219 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ee85d0ff-79c6-4a1f-9b80-f770b04e1e50 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:07.471944 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ee85d0ff-79c6-4a1f-9b80-f770b04e1e50 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:07.480130 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee85d0ff-79c6-4a1f-9b80-f770b04e1e50 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:07.481050 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee85d0ff-79c6-4a1f-9b80-f770b04e1e50 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:07.481682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee85d0ff-79c6-4a1f-9b80-f770b04e1e50 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:07.482491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee85d0ff-79c6-4a1f-9b80-f770b04e1e50 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:07.484496 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee85d0ff-79c6-4a1f-9b80-f770b04e1e50 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:07.485055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee85d0ff-79c6-4a1f-9b80-f770b04e1e50 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:07.549085 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-834d226e-b94f-431f-8af1-13059a6a2fb7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:07.549085 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-834d226e-b94f-431f-8af1-13059a6a2fb7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:07.554562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-834d226e-b94f-431f-8af1-13059a6a2fb7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:07.555055 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-834d226e-b94f-431f-8af1-13059a6a2fb7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:07.555493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-834d226e-b94f-431f-8af1-13059a6a2fb7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:07.556198 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-834d226e-b94f-431f-8af1-13059a6a2fb7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:07.556681 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-834d226e-b94f-431f-8af1-13059a6a2fb7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:07.557107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-834d226e-b94f-431f-8af1-13059a6a2fb7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:07.855902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ee85d0ff-79c6-4a1f-9b80-f770b04e1e50 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:07.869299 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ee85d0ff-79c6-4a1f-9b80-f770b04e1e50 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.406376 Oct 27 09:37:07.871098 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 36/79] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:07 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:07.881752 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-46db9570-98dd-4693-b083-fafe4c5b2bfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:07.882369 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-46db9570-98dd-4693-b083-fafe4c5b2bfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:07.894386 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46db9570-98dd-4693-b083-fafe4c5b2bfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:07.896337 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46db9570-98dd-4693-b083-fafe4c5b2bfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:07.896923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46db9570-98dd-4693-b083-fafe4c5b2bfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:07.902940 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-834d226e-b94f-431f-8af1-13059a6a2fb7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:07.905882 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46db9570-98dd-4693-b083-fafe4c5b2bfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:07.908688 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46db9570-98dd-4693-b083-fafe4c5b2bfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:07.912716 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46db9570-98dd-4693-b083-fafe4c5b2bfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:07.914452 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-834d226e-b94f-431f-8af1-13059a6a2fb7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.371158 Oct 27 09:37:07.928355 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 44/80] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:07 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:07.940495 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:07.941568 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:07.949082 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:07.949746 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:07.950427 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:07.951617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:07.952288 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:07.952971 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:08.031089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-46db9570-98dd-4693-b083-fafe4c5b2bfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:08.042871 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-46db9570-98dd-4693-b083-fafe4c5b2bfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1281 microversion: 2.1 time: 0.169421 Oct 27 09:37:08.044040 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 37/81] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:07 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1281 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:08.069156 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:08.083636 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:08.085507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:08.086989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f42c30cc-57e7-42e0-9e6e-c69d8d287f4e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1339 microversion: 2.20 time: 0.156926 Oct 27 09:37:08.087547 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 45/82] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:07 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1339 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:08.894834 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d98811df-454a-410f-98e3-0f58ead18db3 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:08.895518 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d98811df-454a-410f-98e3-0f58ead18db3 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:08.908955 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d98811df-454a-410f-98e3-0f58ead18db3 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:08.909540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d98811df-454a-410f-98e3-0f58ead18db3 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:08.909989 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d98811df-454a-410f-98e3-0f58ead18db3 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:08.910729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d98811df-454a-410f-98e3-0f58ead18db3 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:08.911184 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d98811df-454a-410f-98e3-0f58ead18db3 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:08.911607 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d98811df-454a-410f-98e3-0f58ead18db3 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:08.941510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5e74a1ae-3a29-47bd-a609-8acfc7a76226 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:08.942149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5e74a1ae-3a29-47bd-a609-8acfc7a76226 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:08.949637 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5e74a1ae-3a29-47bd-a609-8acfc7a76226 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:08.951231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5e74a1ae-3a29-47bd-a609-8acfc7a76226 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:08.953006 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5e74a1ae-3a29-47bd-a609-8acfc7a76226 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:08.960425 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5e74a1ae-3a29-47bd-a609-8acfc7a76226 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:08.961250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5e74a1ae-3a29-47bd-a609-8acfc7a76226 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:08.962115 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5e74a1ae-3a29-47bd-a609-8acfc7a76226 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:09.529633 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5e74a1ae-3a29-47bd-a609-8acfc7a76226 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:09.546462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5e74a1ae-3a29-47bd-a609-8acfc7a76226 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.609951 Oct 27 09:37:09.548162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 46/83] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:08 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:09.554986 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ab1d798c-9dac-4f33-9644-11611633a579 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:09.556391 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ab1d798c-9dac-4f33-9644-11611633a579 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:09.566182 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d98811df-454a-410f-98e3-0f58ead18db3 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:09.567678 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab1d798c-9dac-4f33-9644-11611633a579 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:09.568978 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab1d798c-9dac-4f33-9644-11611633a579 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:09.569709 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab1d798c-9dac-4f33-9644-11611633a579 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:09.573143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab1d798c-9dac-4f33-9644-11611633a579 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:09.573864 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab1d798c-9dac-4f33-9644-11611633a579 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:09.575227 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab1d798c-9dac-4f33-9644-11611633a579 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:09.586469 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d98811df-454a-410f-98e3-0f58ead18db3 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.697033 Oct 27 09:37:09.587067 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 38/84] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:08 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:09.606838 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:09.613889 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:09.625998 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:09.626863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:09.628901 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:09.629867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:09.631837 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:09.632507 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:09.964790 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ab1d798c-9dac-4f33-9644-11611633a579 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:09.986388 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ab1d798c-9dac-4f33-9644-11611633a579 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1279 microversion: 2.1 time: 0.434039 Oct 27 09:37:09.988143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 47/85] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:09 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1279 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:10.447502 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:10.456177 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:10.457692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:10.458831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-84d1d6cd-c8a2-4232-8c6c-bfbe8119d78f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.870819 Oct 27 09:37:10.469323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 39/86] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:09 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:10.573246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cd476766-215f-417a-96bd-18d4fe82455c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:10.575527 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cd476766-215f-417a-96bd-18d4fe82455c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:10.589140 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd476766-215f-417a-96bd-18d4fe82455c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:10.589638 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd476766-215f-417a-96bd-18d4fe82455c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:10.594405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd476766-215f-417a-96bd-18d4fe82455c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:10.595720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd476766-215f-417a-96bd-18d4fe82455c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:10.596258 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd476766-215f-417a-96bd-18d4fe82455c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:10.596728 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd476766-215f-417a-96bd-18d4fe82455c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:10.619240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5881f585-bf93-4427-b09d-28bc9d4f7db6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:10.620476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5881f585-bf93-4427-b09d-28bc9d4f7db6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:10.631595 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5881f585-bf93-4427-b09d-28bc9d4f7db6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:10.635387 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5881f585-bf93-4427-b09d-28bc9d4f7db6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:10.636842 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5881f585-bf93-4427-b09d-28bc9d4f7db6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:10.640076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5881f585-bf93-4427-b09d-28bc9d4f7db6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:10.643661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5881f585-bf93-4427-b09d-28bc9d4f7db6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:10.644246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5881f585-bf93-4427-b09d-28bc9d4f7db6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:11.422581 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cd476766-215f-417a-96bd-18d4fe82455c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:11.441276 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cd476766-215f-417a-96bd-18d4fe82455c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.869894 Oct 27 09:37:11.445084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 48/87] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:10 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:11.464277 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3a428ea4-bbe2-435d-893a-13181cb08e81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:11.468325 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3a428ea4-bbe2-435d-893a-13181cb08e81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:11.494112 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a428ea4-bbe2-435d-893a-13181cb08e81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:11.497635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a428ea4-bbe2-435d-893a-13181cb08e81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:11.498104 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a428ea4-bbe2-435d-893a-13181cb08e81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:11.498868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a428ea4-bbe2-435d-893a-13181cb08e81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:11.499354 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a428ea4-bbe2-435d-893a-13181cb08e81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:11.502751 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a428ea4-bbe2-435d-893a-13181cb08e81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:11.575987 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5881f585-bf93-4427-b09d-28bc9d4f7db6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:11.585863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5881f585-bf93-4427-b09d-28bc9d4f7db6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.972505 Oct 27 09:37:11.586969 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 40/88] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:10 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:11.593065 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:11.594367 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:11.602966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:11.603613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:11.604368 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:11.605303 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:11.605895 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:11.616985 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.009704 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3a428ea4-bbe2-435d-893a-13181cb08e81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:12.024289 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3a428ea4-bbe2-435d-893a-13181cb08e81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.574875 Oct 27 09:37:12.024921 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 49/89] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:11 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:12.082319 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:12.098952 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:12.100670 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:12.101834 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c6d8ac8d-9b65-4aca-b260-2cdb88a39c16 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.513818 Oct 27 09:37:12.103077 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 41/90] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:11 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:12.160483 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-277fae63-2f35-401e-aea4-eb3587d19071 req-022557da-076b-4bc6-bede-4643eed5f39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5232c748-ed0e-4ba8-a76d-1b8b9ffd523c", "tag": "4aa69fa8-90ce-4e7e-909d-73d1c879dbeb"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:12.184423 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-277fae63-2f35-401e-aea4-eb3587d19071 req-022557da-076b-4bc6-bede-4643eed5f39e service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:12.185128 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-277fae63-2f35-401e-aea4-eb3587d19071 req-022557da-076b-4bc6-bede-4643eed5f39e service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:12.185660 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-277fae63-2f35-401e-aea4-eb3587d19071 req-022557da-076b-4bc6-bede-4643eed5f39e service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.204997 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-5dd01470-0bd7-4b53-b0a3-6e5a9bafece8 req-a6d0ce34-c481-4e44-8821-345b72ef5de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41afcd63-98f3-468b-a15d-f925bd7aba8a", "tag": "88c31a6e-f135-454a-a1fa-282d832047fa"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:12.216821 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-277fae63-2f35-401e-aea4-eb3587d19071 req-022557da-076b-4bc6-bede-4643eed5f39e service nova] Creating event network-changed:4aa69fa8-90ce-4e7e-909d-73d1c879dbeb for instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c on hv-cinder-79797 Oct 27 09:37:12.217636 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-277fae63-2f35-401e-aea4-eb3587d19071 req-022557da-076b-4bc6-bede-4643eed5f39e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:37:12.218446 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-277fae63-2f35-401e-aea4-eb3587d19071 req-022557da-076b-4bc6-bede-4643eed5f39e service nova] Acquired lock "compute-rpcapi-router" {{(pid=125361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:37:12.220040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02b4e261-93a2-45f1-acdb-0e35eecb0396 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:12.220953 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02b4e261-93a2-45f1-acdb-0e35eecb0396 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:12.221807 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02b4e261-93a2-45f1-acdb-0e35eecb0396 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.223269 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02b4e261-93a2-45f1-acdb-0e35eecb0396 None None] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:12.224063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02b4e261-93a2-45f1-acdb-0e35eecb0396 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:12.224845 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02b4e261-93a2-45f1-acdb-0e35eecb0396 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.230769 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5dd01470-0bd7-4b53-b0a3-6e5a9bafece8 req-a6d0ce34-c481-4e44-8821-345b72ef5de6 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:12.231259 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5dd01470-0bd7-4b53-b0a3-6e5a9bafece8 req-a6d0ce34-c481-4e44-8821-345b72ef5de6 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:12.231691 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5dd01470-0bd7-4b53-b0a3-6e5a9bafece8 req-a6d0ce34-c481-4e44-8821-345b72ef5de6 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.238409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.compute.rpcapi [None req-02b4e261-93a2-45f1-acdb-0e35eecb0396 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 09:37:12.240478 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02b4e261-93a2-45f1-acdb-0e35eecb0396 None None] Releasing lock "compute-rpcapi-router" {{(pid=125361) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:37:12.263238 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-5dd01470-0bd7-4b53-b0a3-6e5a9bafece8 req-a6d0ce34-c481-4e44-8821-345b72ef5de6 service nova] Creating event network-changed:88c31a6e-f135-454a-a1fa-282d832047fa for instance 41afcd63-98f3-468b-a15d-f925bd7aba8a on hv-cinder-79797 Oct 27 09:37:12.264969 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5dd01470-0bd7-4b53-b0a3-6e5a9bafece8 req-a6d0ce34-c481-4e44-8821-345b72ef5de6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125362) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 09:37:12.265397 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5dd01470-0bd7-4b53-b0a3-6e5a9bafece8 req-a6d0ce34-c481-4e44-8821-345b72ef5de6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125362) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 09:37:12.271489 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-02b4e261-93a2-45f1-acdb-0e35eecb0396 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245103 Oct 27 09:37:12.272766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 50/91] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:12.277991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b362b71f-d903-4d0c-9e24-e8a8c1f3b9e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:12.278611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b362b71f-d903-4d0c-9e24-e8a8c1f3b9e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:12.279419 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b362b71f-d903-4d0c-9e24-e8a8c1f3b9e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.286902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b362b71f-d903-4d0c-9e24-e8a8c1f3b9e0 None None] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:12.287540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b362b71f-d903-4d0c-9e24-e8a8c1f3b9e0 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:12.288120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b362b71f-d903-4d0c-9e24-e8a8c1f3b9e0 None None] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.300786 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.compute.rpcapi [None req-b362b71f-d903-4d0c-9e24-e8a8c1f3b9e0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 09:37:12.301695 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b362b71f-d903-4d0c-9e24-e8a8c1f3b9e0 None None] Releasing lock "compute-rpcapi-router" {{(pid=125362) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 09:37:12.324107 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b362b71f-d903-4d0c-9e24-e8a8c1f3b9e0 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217701 Oct 27 09:37:12.325076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 42/92] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:12.470135 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e4387a7c-64a6-4dba-9c98-1ceeef1405d0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:12.471460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e4387a7c-64a6-4dba-9c98-1ceeef1405d0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:12.477915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4387a7c-64a6-4dba-9c98-1ceeef1405d0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:12.478404 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4387a7c-64a6-4dba-9c98-1ceeef1405d0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:12.478840 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4387a7c-64a6-4dba-9c98-1ceeef1405d0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.479731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4387a7c-64a6-4dba-9c98-1ceeef1405d0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:12.480181 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4387a7c-64a6-4dba-9c98-1ceeef1405d0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:12.480776 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4387a7c-64a6-4dba-9c98-1ceeef1405d0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.617220 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c844c431-0b54-498d-a6a9-9fcc01766704 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:12.620340 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c844c431-0b54-498d-a6a9-9fcc01766704 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:12.627971 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c844c431-0b54-498d-a6a9-9fcc01766704 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:12.628564 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c844c431-0b54-498d-a6a9-9fcc01766704 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:12.629079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c844c431-0b54-498d-a6a9-9fcc01766704 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.629853 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c844c431-0b54-498d-a6a9-9fcc01766704 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:12.630377 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c844c431-0b54-498d-a6a9-9fcc01766704 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:12.630875 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c844c431-0b54-498d-a6a9-9fcc01766704 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:12.763755 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e4387a7c-64a6-4dba-9c98-1ceeef1405d0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:12.773077 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e4387a7c-64a6-4dba-9c98-1ceeef1405d0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.307237 Oct 27 09:37:12.783476 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 51/93] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:12 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:12.814887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c844c431-0b54-498d-a6a9-9fcc01766704 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:12.822500 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c844c431-0b54-498d-a6a9-9fcc01766704 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.212464 Oct 27 09:37:12.823079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 43/94] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:12 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:13.047465 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7ffdd515-4b37-4b12-b9d4-b15edba86a7f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:13.048079 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7ffdd515-4b37-4b12-b9d4-b15edba86a7f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:13.054007 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7ffdd515-4b37-4b12-b9d4-b15edba86a7f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.054495 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7ffdd515-4b37-4b12-b9d4-b15edba86a7f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.054933 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7ffdd515-4b37-4b12-b9d4-b15edba86a7f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.055624 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7ffdd515-4b37-4b12-b9d4-b15edba86a7f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.056073 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7ffdd515-4b37-4b12-b9d4-b15edba86a7f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.056496 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7ffdd515-4b37-4b12-b9d4-b15edba86a7f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.130912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:13.131498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:13.137877 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.138510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.140849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.140849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.141156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.141680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.245362 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7ffdd515-4b37-4b12-b9d4-b15edba86a7f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:13.274344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7ffdd515-4b37-4b12-b9d4-b15edba86a7f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.230744 Oct 27 09:37:13.291227 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 52/95] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:13 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:13.336197 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:13.347998 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:13.350233 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:13.351339 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b71361d2-1d90-461c-b6f8-841676914f06 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.224366 Oct 27 09:37:13.351902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 44/96] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:13 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:13.799706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-59aba95b-568b-4f67-9a2c-a01c72b4e0e5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:13.800548 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-59aba95b-568b-4f67-9a2c-a01c72b4e0e5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:13.807063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59aba95b-568b-4f67-9a2c-a01c72b4e0e5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.807932 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59aba95b-568b-4f67-9a2c-a01c72b4e0e5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.808674 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59aba95b-568b-4f67-9a2c-a01c72b4e0e5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.809774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59aba95b-568b-4f67-9a2c-a01c72b4e0e5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.810371 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59aba95b-568b-4f67-9a2c-a01c72b4e0e5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.811009 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59aba95b-568b-4f67-9a2c-a01c72b4e0e5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.847287 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5256a012-cc75-4c59-9ab4-83fae3376fec tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:13.848070 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5256a012-cc75-4c59-9ab4-83fae3376fec tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:13.857225 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5256a012-cc75-4c59-9ab4-83fae3376fec tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.857778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5256a012-cc75-4c59-9ab4-83fae3376fec tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.858699 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5256a012-cc75-4c59-9ab4-83fae3376fec tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:13.859387 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5256a012-cc75-4c59-9ab4-83fae3376fec tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:13.859833 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5256a012-cc75-4c59-9ab4-83fae3376fec tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:13.860246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5256a012-cc75-4c59-9ab4-83fae3376fec tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:14.031107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-59aba95b-568b-4f67-9a2c-a01c72b4e0e5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:14.041440 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-59aba95b-568b-4f67-9a2c-a01c72b4e0e5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.246412 Oct 27 09:37:14.053281 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 53/97] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:13 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:14.081586 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5256a012-cc75-4c59-9ab4-83fae3376fec tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:14.089560 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5256a012-cc75-4c59-9ab4-83fae3376fec tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.247177 Oct 27 09:37:14.090127 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 45/98] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:13 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:14.315153 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-33f40ec8-a661-4600-a0c4-37bf5aa8bd9a req-157a7460-282a-4136-b6dc-273e109aa5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed", "tag": "27493571-2a5c-4be1-8467-ef2c9634fcc8"}, {"name": "network-changed", "server_uuid": "8ac6a130-38c4-4843-b9a8-118d25c11c18", "tag": "0e6b0478-48aa-4f67-86d8-eb4b392e3971"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:14.316989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-fe36e7a6-35dc-4ad4-9a99-d275527d384d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:14.319357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-fe36e7a6-35dc-4ad4-9a99-d275527d384d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:14.338636 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-33f40ec8-a661-4600-a0c4-37bf5aa8bd9a req-157a7460-282a-4136-b6dc-273e109aa5c5 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:14.339504 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-33f40ec8-a661-4600-a0c4-37bf5aa8bd9a req-157a7460-282a-4136-b6dc-273e109aa5c5 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:14.340811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-33f40ec8-a661-4600-a0c4-37bf5aa8bd9a req-157a7460-282a-4136-b6dc-273e109aa5c5 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:14.343666 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fe36e7a6-35dc-4ad4-9a99-d275527d384d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:14.345118 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fe36e7a6-35dc-4ad4-9a99-d275527d384d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:14.345563 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fe36e7a6-35dc-4ad4-9a99-d275527d384d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:14.351076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fe36e7a6-35dc-4ad4-9a99-d275527d384d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:14.351993 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fe36e7a6-35dc-4ad4-9a99-d275527d384d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:14.354927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fe36e7a6-35dc-4ad4-9a99-d275527d384d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:14.367393 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-33f40ec8-a661-4600-a0c4-37bf5aa8bd9a req-157a7460-282a-4136-b6dc-273e109aa5c5 service nova] Creating event network-changed:27493571-2a5c-4be1-8467-ef2c9634fcc8 for instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed on hv-cinder-79797 Oct 27 09:37:14.368341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-33f40ec8-a661-4600-a0c4-37bf5aa8bd9a req-157a7460-282a-4136-b6dc-273e109aa5c5 service nova] Creating event network-changed:0e6b0478-48aa-4f67-86d8-eb4b392e3971 for instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 on hv-cinder-79797 Oct 27 09:37:14.381470 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-33f40ec8-a661-4600-a0c4-37bf5aa8bd9a req-157a7460-282a-4136-b6dc-273e109aa5c5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077329 Oct 27 09:37:14.382679 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 46/99] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:14.390578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-9ef70643-be50-4ba0-9ef4-30f329f5116d req-15b446aa-1ff1-406d-a854-a60f68db7190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d7180c7-c669-4b10-b463-9910c0eebbdd", "tag": "8ce4a07b-23e9-45ec-a2f8-1e00ccb8e740"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:14.403819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9ef70643-be50-4ba0-9ef4-30f329f5116d req-15b446aa-1ff1-406d-a854-a60f68db7190 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:14.405622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9ef70643-be50-4ba0-9ef4-30f329f5116d req-15b446aa-1ff1-406d-a854-a60f68db7190 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:14.406244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9ef70643-be50-4ba0-9ef4-30f329f5116d req-15b446aa-1ff1-406d-a854-a60f68db7190 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:14.422426 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-9ef70643-be50-4ba0-9ef4-30f329f5116d req-15b446aa-1ff1-406d-a854-a60f68db7190 service nova] Creating event network-changed:8ce4a07b-23e9-45ec-a2f8-1e00ccb8e740 for instance 9d7180c7-c669-4b10-b463-9910c0eebbdd on hv-cinder-79797 Oct 27 09:37:14.429546 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-9ef70643-be50-4ba0-9ef4-30f329f5116d req-15b446aa-1ff1-406d-a854-a60f68db7190 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044946 Oct 27 09:37:14.430608 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 47/100] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:14.446528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:14.448114 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:14.458773 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:14.459498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:14.460226 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:14.461400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:14.462664 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:14.463266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:14.719817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-fe36e7a6-35dc-4ad4-9a99-d275527d384d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:14.732055 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-fe36e7a6-35dc-4ad4-9a99-d275527d384d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.427962 Oct 27 09:37:14.733697 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 54/101] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:14 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:14.887321 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:14.925571 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:14.933553 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:14.937240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8b454404-31c3-4f6a-a23b-d8ef994e5d1c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.503575 Oct 27 09:37:14.937844 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 48/102] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:14 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:15.067157 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ef67c990-d8f7-4163-8eb0-9df48c206e8f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:15.067882 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ef67c990-d8f7-4163-8eb0-9df48c206e8f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:15.078468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ef67c990-d8f7-4163-8eb0-9df48c206e8f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:15.078961 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ef67c990-d8f7-4163-8eb0-9df48c206e8f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:15.079396 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ef67c990-d8f7-4163-8eb0-9df48c206e8f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:15.080273 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ef67c990-d8f7-4163-8eb0-9df48c206e8f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:15.081266 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ef67c990-d8f7-4163-8eb0-9df48c206e8f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:15.083505 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ef67c990-d8f7-4163-8eb0-9df48c206e8f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:15.115952 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ee6760cf-fb76-46a4-b842-d347b81cfb12 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:15.117029 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ee6760cf-fb76-46a4-b842-d347b81cfb12 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:15.126742 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee6760cf-fb76-46a4-b842-d347b81cfb12 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:15.127590 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee6760cf-fb76-46a4-b842-d347b81cfb12 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:15.129529 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee6760cf-fb76-46a4-b842-d347b81cfb12 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:15.133016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee6760cf-fb76-46a4-b842-d347b81cfb12 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:15.134660 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee6760cf-fb76-46a4-b842-d347b81cfb12 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:15.137292 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee6760cf-fb76-46a4-b842-d347b81cfb12 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:15.547558 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ee6760cf-fb76-46a4-b842-d347b81cfb12 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:15.559422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ee6760cf-fb76-46a4-b842-d347b81cfb12 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.447426 Oct 27 09:37:15.562517 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 49/103] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:15 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:15.573252 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ef67c990-d8f7-4163-8eb0-9df48c206e8f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:15.585348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:15.588175 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ef67c990-d8f7-4163-8eb0-9df48c206e8f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.524714 Oct 27 09:37:15.589036 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 55/104] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:15 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:15.756554 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c036fbe7-f2eb-41e5-90e8-596fe3547752 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:15.757365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c036fbe7-f2eb-41e5-90e8-596fe3547752 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:15.764840 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c036fbe7-f2eb-41e5-90e8-596fe3547752 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:15.765492 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c036fbe7-f2eb-41e5-90e8-596fe3547752 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:15.765922 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c036fbe7-f2eb-41e5-90e8-596fe3547752 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:15.766657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c036fbe7-f2eb-41e5-90e8-596fe3547752 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:15.767103 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c036fbe7-f2eb-41e5-90e8-596fe3547752 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:15.767527 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c036fbe7-f2eb-41e5-90e8-596fe3547752 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:15.924621 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c036fbe7-f2eb-41e5-90e8-596fe3547752 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:15.932714 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c036fbe7-f2eb-41e5-90e8-596fe3547752 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.180099 Oct 27 09:37:15.933295 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 50/105] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:15 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:15.963966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:15.964836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:15.971137 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:15.971817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:15.972403 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:15.973282 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:15.973890 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:15.974464 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:16.388582 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:16.403707 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:16.407289 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:16.411423 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6edd34a2-bf1a-4ee6-a5d3-72428f9e7e29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.451952 Oct 27 09:37:16.412084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 56/106] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:15 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:16.587925 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-70df19e0-7b05-4151-a81d-2a34eaf0c4f9 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:16.588799 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-70df19e0-7b05-4151-a81d-2a34eaf0c4f9 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:16.601812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-70df19e0-7b05-4151-a81d-2a34eaf0c4f9 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:16.602516 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-70df19e0-7b05-4151-a81d-2a34eaf0c4f9 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:16.603140 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-70df19e0-7b05-4151-a81d-2a34eaf0c4f9 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:16.604676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-70df19e0-7b05-4151-a81d-2a34eaf0c4f9 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:16.610638 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-70df19e0-7b05-4151-a81d-2a34eaf0c4f9 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:16.611279 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-70df19e0-7b05-4151-a81d-2a34eaf0c4f9 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:16.611537 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a9143da5-e645-4cbe-9cfa-77902611fac8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:16.612242 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a9143da5-e645-4cbe-9cfa-77902611fac8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:16.629925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9143da5-e645-4cbe-9cfa-77902611fac8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:16.630651 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9143da5-e645-4cbe-9cfa-77902611fac8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:16.631261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9143da5-e645-4cbe-9cfa-77902611fac8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:16.634980 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9143da5-e645-4cbe-9cfa-77902611fac8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:16.636560 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9143da5-e645-4cbe-9cfa-77902611fac8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:16.638510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9143da5-e645-4cbe-9cfa-77902611fac8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:16.866099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-70df19e0-7b05-4151-a81d-2a34eaf0c4f9 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:16.870205 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:16.875653 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-70df19e0-7b05-4151-a81d-2a34eaf0c4f9 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.292146 Oct 27 09:37:16.876240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 51/107] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:16 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:16.919063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a9143da5-e645-4cbe-9cfa-77902611fac8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:16.929865 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a9143da5-e645-4cbe-9cfa-77902611fac8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.322575 Oct 27 09:37:16.930880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 57/108] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:16 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:16.957926 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-85059c76-7d81-4162-9200-502e4ea5e200 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:16.958603 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-85059c76-7d81-4162-9200-502e4ea5e200 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:16.970579 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85059c76-7d81-4162-9200-502e4ea5e200 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:16.972570 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85059c76-7d81-4162-9200-502e4ea5e200 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:16.974387 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85059c76-7d81-4162-9200-502e4ea5e200 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:16.976505 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85059c76-7d81-4162-9200-502e4ea5e200 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:16.977323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85059c76-7d81-4162-9200-502e4ea5e200 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:16.979234 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85059c76-7d81-4162-9200-502e4ea5e200 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:17.178815 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-85059c76-7d81-4162-9200-502e4ea5e200 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:17.192634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-85059c76-7d81-4162-9200-502e4ea5e200 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.239206 Oct 27 09:37:17.203955 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 52/109] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:16 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:17.437636 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:17.438240 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:17.448536 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:17.449033 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:17.449457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:17.451373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:17.452330 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:17.452783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:17.603181 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:17.614186 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:17.615750 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:17.617011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b486e4e4-35dc-40cd-8637-0021025e8a09 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.183918 Oct 27 09:37:17.617975 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 58/110] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:17 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:17.900440 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5d829ebb-40ab-493f-a4a7-04738435ecfc tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:17.901528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5d829ebb-40ab-493f-a4a7-04738435ecfc tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:17.908275 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5d829ebb-40ab-493f-a4a7-04738435ecfc tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:17.908863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5d829ebb-40ab-493f-a4a7-04738435ecfc tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:17.909296 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5d829ebb-40ab-493f-a4a7-04738435ecfc tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:17.910049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5d829ebb-40ab-493f-a4a7-04738435ecfc tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:17.910506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5d829ebb-40ab-493f-a4a7-04738435ecfc tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:17.910989 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5d829ebb-40ab-493f-a4a7-04738435ecfc tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:17.954139 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c35c7e83-7aa4-4696-968b-1bb774efa589 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:17.954838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c35c7e83-7aa4-4696-968b-1bb774efa589 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:17.965463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c35c7e83-7aa4-4696-968b-1bb774efa589 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:17.966261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c35c7e83-7aa4-4696-968b-1bb774efa589 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:17.967066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c35c7e83-7aa4-4696-968b-1bb774efa589 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:17.968278 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c35c7e83-7aa4-4696-968b-1bb774efa589 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:17.969292 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c35c7e83-7aa4-4696-968b-1bb774efa589 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:17.975570 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c35c7e83-7aa4-4696-968b-1bb774efa589 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:18.130385 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5d829ebb-40ab-493f-a4a7-04738435ecfc tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:18.139354 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5d829ebb-40ab-493f-a4a7-04738435ecfc tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.243824 Oct 27 09:37:18.153894 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 53/111] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:17 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:18.179096 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c35c7e83-7aa4-4696-968b-1bb774efa589 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:18.189081 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c35c7e83-7aa4-4696-968b-1bb774efa589 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.239447 Oct 27 09:37:18.190040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 59/112] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:17 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:18.223471 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-50cd5f54-e0e4-437a-a08d-caf5a5829458 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:18.224083 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-50cd5f54-e0e4-437a-a08d-caf5a5829458 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:18.231969 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50cd5f54-e0e4-437a-a08d-caf5a5829458 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:18.232539 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50cd5f54-e0e4-437a-a08d-caf5a5829458 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:18.233546 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50cd5f54-e0e4-437a-a08d-caf5a5829458 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:18.235868 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50cd5f54-e0e4-437a-a08d-caf5a5829458 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:18.236444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50cd5f54-e0e4-437a-a08d-caf5a5829458 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:18.237138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50cd5f54-e0e4-437a-a08d-caf5a5829458 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:18.407165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-50cd5f54-e0e4-437a-a08d-caf5a5829458 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:18.415446 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-50cd5f54-e0e4-437a-a08d-caf5a5829458 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.195637 Oct 27 09:37:18.427176 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 54/113] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:18 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:18.645525 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:18.646128 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:18.655109 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:18.655934 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:18.656510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:18.657425 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:18.658023 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:18.659433 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:18.841620 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:18.854053 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:18.855847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:18.857213 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-71a21e94-7740-4604-b9d1-1f048e3f220a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.218404 Oct 27 09:37:18.858455 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 60/114] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:18 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:19.163932 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d4acaf55-2079-4f70-86f1-e861e36f19da tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:19.164628 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d4acaf55-2079-4f70-86f1-e861e36f19da tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:19.174238 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d4acaf55-2079-4f70-86f1-e861e36f19da tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.174731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d4acaf55-2079-4f70-86f1-e861e36f19da tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.178489 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d4acaf55-2079-4f70-86f1-e861e36f19da tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.179069 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d4acaf55-2079-4f70-86f1-e861e36f19da tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.179731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d4acaf55-2079-4f70-86f1-e861e36f19da tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.180399 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d4acaf55-2079-4f70-86f1-e861e36f19da tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.212849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-fb646b6b-3554-4dbc-b9dd-e573147721c4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:19.214863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-fb646b6b-3554-4dbc-b9dd-e573147721c4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:19.225679 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fb646b6b-3554-4dbc-b9dd-e573147721c4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.226307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fb646b6b-3554-4dbc-b9dd-e573147721c4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.226846 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fb646b6b-3554-4dbc-b9dd-e573147721c4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.229599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fb646b6b-3554-4dbc-b9dd-e573147721c4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.230193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fb646b6b-3554-4dbc-b9dd-e573147721c4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.230718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fb646b6b-3554-4dbc-b9dd-e573147721c4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.865991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d4acaf55-2079-4f70-86f1-e861e36f19da tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:19.887397 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d4acaf55-2079-4f70-86f1-e861e36f19da tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.727356 Oct 27 09:37:19.887982 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 55/115] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:19 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:19.906817 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-94e5b19a-3fa2-4f9e-9b18-096a7307903a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:19.909206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-94e5b19a-3fa2-4f9e-9b18-096a7307903a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:19.922277 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-94e5b19a-3fa2-4f9e-9b18-096a7307903a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.923147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-94e5b19a-3fa2-4f9e-9b18-096a7307903a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.923804 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-94e5b19a-3fa2-4f9e-9b18-096a7307903a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.924943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-94e5b19a-3fa2-4f9e-9b18-096a7307903a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:19.925769 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-94e5b19a-3fa2-4f9e-9b18-096a7307903a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:19.926407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-94e5b19a-3fa2-4f9e-9b18-096a7307903a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:19.977434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-fb646b6b-3554-4dbc-b9dd-e573147721c4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:19.991305 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-fb646b6b-3554-4dbc-b9dd-e573147721c4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.782739 Oct 27 09:37:19.992544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 61/116] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:19 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:19.997268 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:20.001260 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:20.018301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:20.024373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:20.024373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:20.024373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:20.024373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:20.025076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:20.779804 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-94e5b19a-3fa2-4f9e-9b18-096a7307903a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:20.793816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-94e5b19a-3fa2-4f9e-9b18-096a7307903a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.900240 Oct 27 09:37:20.794418 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 56/117] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:19 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:20.910764 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:20.911816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-321d3741-0900-4853-bc26-677546394196 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:20.912838 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-321d3741-0900-4853-bc26-677546394196 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:20.924139 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:20.925866 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-321d3741-0900-4853-bc26-677546394196 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:20.929089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-321d3741-0900-4853-bc26-677546394196 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:20.930030 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:20.930634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-321d3741-0900-4853-bc26-677546394196 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:20.931404 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b127daf1-2821-4d2f-a91c-33b895ac92d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.937726 Oct 27 09:37:20.932342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-321d3741-0900-4853-bc26-677546394196 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:20.933476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-321d3741-0900-4853-bc26-677546394196 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:20.935059 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-321d3741-0900-4853-bc26-677546394196 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:20.951215 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 62/118] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:19 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:21.015380 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b7d2d661-0ee8-4a51-8622-99dba112eed1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:21.016474 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b7d2d661-0ee8-4a51-8622-99dba112eed1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:21.025623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7d2d661-0ee8-4a51-8622-99dba112eed1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:21.027615 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7d2d661-0ee8-4a51-8622-99dba112eed1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:21.028554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7d2d661-0ee8-4a51-8622-99dba112eed1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:21.029854 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7d2d661-0ee8-4a51-8622-99dba112eed1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:21.030608 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7d2d661-0ee8-4a51-8622-99dba112eed1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:21.031726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7d2d661-0ee8-4a51-8622-99dba112eed1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:21.293331 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-321d3741-0900-4853-bc26-677546394196 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:21.307142 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-321d3741-0900-4853-bc26-677546394196 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.399576 Oct 27 09:37:21.308989 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 57/119] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:20 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:21.374944 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b7d2d661-0ee8-4a51-8622-99dba112eed1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:21.383603 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b7d2d661-0ee8-4a51-8622-99dba112eed1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.371958 Oct 27 09:37:21.384359 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 63/120] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:21 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:21.822632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-952a0d00-f4a1-4c86-a7c0-2cce062e0845 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:21.823476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-952a0d00-f4a1-4c86-a7c0-2cce062e0845 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:21.832818 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-952a0d00-f4a1-4c86-a7c0-2cce062e0845 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:21.834518 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-952a0d00-f4a1-4c86-a7c0-2cce062e0845 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:21.837904 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-952a0d00-f4a1-4c86-a7c0-2cce062e0845 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:21.839526 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-952a0d00-f4a1-4c86-a7c0-2cce062e0845 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:21.840959 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-952a0d00-f4a1-4c86-a7c0-2cce062e0845 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:21.843664 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-952a0d00-f4a1-4c86-a7c0-2cce062e0845 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:21.959839 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:21.960745 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:21.968619 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:21.973516 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:21.974394 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:21.975299 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:21.975910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:21.976480 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:22.096089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-952a0d00-f4a1-4c86-a7c0-2cce062e0845 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:22.110526 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-952a0d00-f4a1-4c86-a7c0-2cce062e0845 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.292139 Oct 27 09:37:22.119401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 58/121] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:21 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:22.227562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:22.236419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:22.242275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:22.245883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:22.247740 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e74f3aaf-8070-4ee3-9cf5-40c05790f315 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.292561 Oct 27 09:37:22.261148 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 64/122] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:21 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:37:22.330823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c7928b47-2d80-43a6-a37d-89b5b7d3445d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:22.331430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c7928b47-2d80-43a6-a37d-89b5b7d3445d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:22.339427 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:22.348974 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7928b47-2d80-43a6-a37d-89b5b7d3445d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:22.349463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7928b47-2d80-43a6-a37d-89b5b7d3445d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:22.349885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7928b47-2d80-43a6-a37d-89b5b7d3445d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:22.350638 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7928b47-2d80-43a6-a37d-89b5b7d3445d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:22.351007 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7928b47-2d80-43a6-a37d-89b5b7d3445d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:22.359405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7928b47-2d80-43a6-a37d-89b5b7d3445d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:22.411613 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7905c5f7-7bd9-423d-8c36-e7edfba53556 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:22.412224 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7905c5f7-7bd9-423d-8c36-e7edfba53556 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:22.430749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7905c5f7-7bd9-423d-8c36-e7edfba53556 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:22.431263 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7905c5f7-7bd9-423d-8c36-e7edfba53556 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:22.431696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7905c5f7-7bd9-423d-8c36-e7edfba53556 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:22.432407 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7905c5f7-7bd9-423d-8c36-e7edfba53556 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:22.436673 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7905c5f7-7bd9-423d-8c36-e7edfba53556 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:22.438155 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7905c5f7-7bd9-423d-8c36-e7edfba53556 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:22.576578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c7928b47-2d80-43a6-a37d-89b5b7d3445d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:22.588322 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c7928b47-2d80-43a6-a37d-89b5b7d3445d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.261500 Oct 27 09:37:22.612202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 59/123] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:22 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:22.677871 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7905c5f7-7bd9-423d-8c36-e7edfba53556 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:22.687125 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7905c5f7-7bd9-423d-8c36-e7edfba53556 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.285329 Oct 27 09:37:22.687704 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 65/124] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:22 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:23.135557 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ac037d1b-3573-4b9b-ae2e-6dc26db5c1da tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:23.137646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ac037d1b-3573-4b9b-ae2e-6dc26db5c1da tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:23.149374 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ac037d1b-3573-4b9b-ae2e-6dc26db5c1da tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.150477 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ac037d1b-3573-4b9b-ae2e-6dc26db5c1da tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.151089 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ac037d1b-3573-4b9b-ae2e-6dc26db5c1da tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:23.157986 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ac037d1b-3573-4b9b-ae2e-6dc26db5c1da tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.158926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ac037d1b-3573-4b9b-ae2e-6dc26db5c1da tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.159517 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ac037d1b-3573-4b9b-ae2e-6dc26db5c1da tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:23.376071 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ac037d1b-3573-4b9b-ae2e-6dc26db5c1da tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:23.386516 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ac037d1b-3573-4b9b-ae2e-6dc26db5c1da tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.254741 Oct 27 09:37:23.387382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 66/125] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:23 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:23.394208 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:23.394843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:23.403392 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.404612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.405215 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:23.406315 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.407005 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.407855 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:23.601262 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-f0d828cf-39cc-4df2-a751-b4b75d0ef6d3 req-c0f92d11-44e7-4300-9017-6d3a1a550909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed", "name": "network-vif-plugged", "status": "completed", "tag": "27493571-2a5c-4be1-8467-ef2c9634fcc8"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:23.618131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-f0d828cf-39cc-4df2-a751-b4b75d0ef6d3 req-c0f92d11-44e7-4300-9017-6d3a1a550909 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.621900 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-f0d828cf-39cc-4df2-a751-b4b75d0ef6d3 req-c0f92d11-44e7-4300-9017-6d3a1a550909 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.622607 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-f0d828cf-39cc-4df2-a751-b4b75d0ef6d3 req-c0f92d11-44e7-4300-9017-6d3a1a550909 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:23.651931 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-f0d828cf-39cc-4df2-a751-b4b75d0ef6d3 req-c0f92d11-44e7-4300-9017-6d3a1a550909 service nova] Creating event network-vif-plugged:27493571-2a5c-4be1-8467-ef2c9634fcc8 for instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed on hv-cinder-79797 Oct 27 09:37:23.666026 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-f0d828cf-39cc-4df2-a751-b4b75d0ef6d3 req-c0f92d11-44e7-4300-9017-6d3a1a550909 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.581511 Oct 27 09:37:23.667163 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 60/126] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:23.678575 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2ea57151-11fd-41cd-ac50-73f3724debc6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:23.681915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:23.683410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2ea57151-11fd-41cd-ac50-73f3724debc6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:23.694137 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:23.694451 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ea57151-11fd-41cd-ac50-73f3724debc6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.695590 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ea57151-11fd-41cd-ac50-73f3724debc6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.697870 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:23.699399 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5eefb3a6-1d19-4e0c-a833-b5f8a9c09b0d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.310634 Oct 27 09:37:23.700661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 67/127] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:23 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:23.704849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ea57151-11fd-41cd-ac50-73f3724debc6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:23.707400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ea57151-11fd-41cd-ac50-73f3724debc6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.709498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ea57151-11fd-41cd-ac50-73f3724debc6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.710211 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ea57151-11fd-41cd-ac50-73f3724debc6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:23.721294 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e315d990-6fa6-48c9-9232-9c001ee9afea tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:23.722881 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e315d990-6fa6-48c9-9232-9c001ee9afea tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:23.744296 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e315d990-6fa6-48c9-9232-9c001ee9afea tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.744879 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e315d990-6fa6-48c9-9232-9c001ee9afea tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.745319 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e315d990-6fa6-48c9-9232-9c001ee9afea tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:23.746054 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e315d990-6fa6-48c9-9232-9c001ee9afea tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:23.746508 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e315d990-6fa6-48c9-9232-9c001ee9afea tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:23.746930 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e315d990-6fa6-48c9-9232-9c001ee9afea tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:24.021132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2ea57151-11fd-41cd-ac50-73f3724debc6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:24.033755 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2ea57151-11fd-41cd-ac50-73f3724debc6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.365354 Oct 27 09:37:24.034334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 61/128] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:23 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:24.046978 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e315d990-6fa6-48c9-9232-9c001ee9afea tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:24.057653 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e315d990-6fa6-48c9-9232-9c001ee9afea tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.350439 Oct 27 09:37:24.059537 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 68/129] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:23 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:24.413927 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d0afd680-534f-4cd6-be84-bf23355dcc23 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:24.414529 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d0afd680-534f-4cd6-be84-bf23355dcc23 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:24.421631 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d0afd680-534f-4cd6-be84-bf23355dcc23 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:24.426060 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d0afd680-534f-4cd6-be84-bf23355dcc23 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:24.426859 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d0afd680-534f-4cd6-be84-bf23355dcc23 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:24.429606 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d0afd680-534f-4cd6-be84-bf23355dcc23 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:24.430246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d0afd680-534f-4cd6-be84-bf23355dcc23 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:24.431628 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d0afd680-534f-4cd6-be84-bf23355dcc23 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:24.666658 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d0afd680-534f-4cd6-be84-bf23355dcc23 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:24.682142 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d0afd680-534f-4cd6-be84-bf23355dcc23 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.271844 Oct 27 09:37:24.699781 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 62/130] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:24 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:24.727879 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:24.729089 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:24.755289 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:24.757662 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:24.758228 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:24.759008 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:24.759487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:24.759912 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:24.967420 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:24.976692 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:24.978363 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:24.979684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b5d32d2b-574c-4da2-a47c-363752ae79ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.256905 Oct 27 09:37:24.997365 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 69/131] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:24 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:25.058542 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b79f61e1-4c23-4066-8064-8756efb276e6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:25.059174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b79f61e1-4c23-4066-8064-8756efb276e6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:25.066922 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b79f61e1-4c23-4066-8064-8756efb276e6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:25.067402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b79f61e1-4c23-4066-8064-8756efb276e6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:25.067830 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b79f61e1-4c23-4066-8064-8756efb276e6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:25.068532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b79f61e1-4c23-4066-8064-8756efb276e6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:25.070733 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b79f61e1-4c23-4066-8064-8756efb276e6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:25.070995 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b79f61e1-4c23-4066-8064-8756efb276e6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:25.082551 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-77258a1e-5f84-4f40-ac93-c00c5635cc58 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:25.084719 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-77258a1e-5f84-4f40-ac93-c00c5635cc58 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:25.092983 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-77258a1e-5f84-4f40-ac93-c00c5635cc58 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:25.093461 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-77258a1e-5f84-4f40-ac93-c00c5635cc58 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:25.093896 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-77258a1e-5f84-4f40-ac93-c00c5635cc58 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:25.096449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-77258a1e-5f84-4f40-ac93-c00c5635cc58 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:25.097016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-77258a1e-5f84-4f40-ac93-c00c5635cc58 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:25.097445 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-77258a1e-5f84-4f40-ac93-c00c5635cc58 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:25.302548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b79f61e1-4c23-4066-8064-8756efb276e6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:25.314147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b79f61e1-4c23-4066-8064-8756efb276e6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.259242 Oct 27 09:37:25.327344 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 63/132] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:25 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:25.366529 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-77258a1e-5f84-4f40-ac93-c00c5635cc58 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:25.378574 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-77258a1e-5f84-4f40-ac93-c00c5635cc58 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.299757 Oct 27 09:37:25.381011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 70/133] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:25 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:25.699926 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-42b39390-1170-46f9-943e-c27d0bafe6c5 req-fa5ccacc-4c6b-4d30-a231-4a6aa0248e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41afcd63-98f3-468b-a15d-f925bd7aba8a", "name": "network-vif-plugged", "status": "completed", "tag": "88c31a6e-f135-454a-a1fa-282d832047fa"}, {"server_uuid": "5232c748-ed0e-4ba8-a76d-1b8b9ffd523c", "name": "network-vif-plugged", "status": "completed", "tag": "4aa69fa8-90ce-4e7e-909d-73d1c879dbeb"}, {"server_uuid": "9d7180c7-c669-4b10-b463-9910c0eebbdd", "name": "network-vif-plugged", "status": "completed", "tag": "8ce4a07b-23e9-45ec-a2f8-1e00ccb8e740"}, {"server_uuid": "8ac6a130-38c4-4843-b9a8-118d25c11c18", "name": "network-vif-plugged", "status": "completed", "tag": "0e6b0478-48aa-4f67-86d8-eb4b392e3971"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:25.707589 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-efaab69c-a5de-4351-8ec8-f344771f9729 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:25.708274 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-efaab69c-a5de-4351-8ec8-f344771f9729 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:25.715935 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efaab69c-a5de-4351-8ec8-f344771f9729 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:25.716956 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efaab69c-a5de-4351-8ec8-f344771f9729 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:25.717378 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-42b39390-1170-46f9-943e-c27d0bafe6c5 req-fa5ccacc-4c6b-4d30-a231-4a6aa0248e2b service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:25.717509 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efaab69c-a5de-4351-8ec8-f344771f9729 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:25.718068 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-42b39390-1170-46f9-943e-c27d0bafe6c5 req-fa5ccacc-4c6b-4d30-a231-4a6aa0248e2b service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:25.718199 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efaab69c-a5de-4351-8ec8-f344771f9729 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:25.718634 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efaab69c-a5de-4351-8ec8-f344771f9729 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:25.718747 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-42b39390-1170-46f9-943e-c27d0bafe6c5 req-fa5ccacc-4c6b-4d30-a231-4a6aa0248e2b service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:25.719070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efaab69c-a5de-4351-8ec8-f344771f9729 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:25.740381 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-42b39390-1170-46f9-943e-c27d0bafe6c5 req-fa5ccacc-4c6b-4d30-a231-4a6aa0248e2b service nova] Creating event network-vif-plugged:88c31a6e-f135-454a-a1fa-282d832047fa for instance 41afcd63-98f3-468b-a15d-f925bd7aba8a on hv-cinder-79797 Oct 27 09:37:25.741091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-42b39390-1170-46f9-943e-c27d0bafe6c5 req-fa5ccacc-4c6b-4d30-a231-4a6aa0248e2b service nova] Creating event network-vif-plugged:4aa69fa8-90ce-4e7e-909d-73d1c879dbeb for instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c on hv-cinder-79797 Oct 27 09:37:25.741915 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-42b39390-1170-46f9-943e-c27d0bafe6c5 req-fa5ccacc-4c6b-4d30-a231-4a6aa0248e2b service nova] Creating event network-vif-plugged:8ce4a07b-23e9-45ec-a2f8-1e00ccb8e740 for instance 9d7180c7-c669-4b10-b463-9910c0eebbdd on hv-cinder-79797 Oct 27 09:37:25.742727 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-42b39390-1170-46f9-943e-c27d0bafe6c5 req-fa5ccacc-4c6b-4d30-a231-4a6aa0248e2b service nova] Creating event network-vif-plugged:0e6b0478-48aa-4f67-86d8-eb4b392e3971 for instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 on hv-cinder-79797 Oct 27 09:37:25.757886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-42b39390-1170-46f9-943e-c27d0bafe6c5 req-fa5ccacc-4c6b-4d30-a231-4a6aa0248e2b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.061406 Oct 27 09:37:25.759832 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 64/134] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:25.929815 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-efaab69c-a5de-4351-8ec8-f344771f9729 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:25.938591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-efaab69c-a5de-4351-8ec8-f344771f9729 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.236554 Oct 27 09:37:25.946826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 71/135] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:25 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:26.008818 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:26.009686 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:26.019891 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.020387 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.025390 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:26.026138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.026607 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.027040 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:26.226945 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:26.242057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:26.243951 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:26.245294 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-78c2fd07-b357-4d6e-b1b8-56e059b3b9b8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.242716 Oct 27 09:37:26.245974 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 65/136] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:26 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:26.343168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-024603ba-f545-40a1-97ab-03b58e195681 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:26.344200 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-024603ba-f545-40a1-97ab-03b58e195681 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:26.363246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-024603ba-f545-40a1-97ab-03b58e195681 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.365413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-024603ba-f545-40a1-97ab-03b58e195681 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.366669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-024603ba-f545-40a1-97ab-03b58e195681 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:26.367852 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-024603ba-f545-40a1-97ab-03b58e195681 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.369880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-024603ba-f545-40a1-97ab-03b58e195681 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.370719 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-024603ba-f545-40a1-97ab-03b58e195681 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:26.410590 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ec75db6b-169b-4730-bfe9-6a9343a0cdf3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:26.411423 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ec75db6b-169b-4730-bfe9-6a9343a0cdf3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:26.418798 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:26.419126 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec75db6b-169b-4730-bfe9-6a9343a0cdf3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.420963 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec75db6b-169b-4730-bfe9-6a9343a0cdf3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.421644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec75db6b-169b-4730-bfe9-6a9343a0cdf3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:26.422584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec75db6b-169b-4730-bfe9-6a9343a0cdf3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.423728 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec75db6b-169b-4730-bfe9-6a9343a0cdf3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.424235 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec75db6b-169b-4730-bfe9-6a9343a0cdf3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:26.647774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-024603ba-f545-40a1-97ab-03b58e195681 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:26.660123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-024603ba-f545-40a1-97ab-03b58e195681 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.323938 Oct 27 09:37:26.662083 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 72/137] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:26 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:26.693211 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ec75db6b-169b-4730-bfe9-6a9343a0cdf3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:26.702055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ec75db6b-169b-4730-bfe9-6a9343a0cdf3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.298878 Oct 27 09:37:26.702055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 66/138] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:26 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:26.973688 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-61496f6d-6f6a-459f-b38a-f02fb009b3b7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:26.974405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-61496f6d-6f6a-459f-b38a-f02fb009b3b7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:26.980510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61496f6d-6f6a-459f-b38a-f02fb009b3b7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.981028 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61496f6d-6f6a-459f-b38a-f02fb009b3b7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.981466 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61496f6d-6f6a-459f-b38a-f02fb009b3b7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:26.982744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61496f6d-6f6a-459f-b38a-f02fb009b3b7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:26.983483 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61496f6d-6f6a-459f-b38a-f02fb009b3b7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:26.983911 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61496f6d-6f6a-459f-b38a-f02fb009b3b7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:27.130904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-61496f6d-6f6a-459f-b38a-f02fb009b3b7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:27.139336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-61496f6d-6f6a-459f-b38a-f02fb009b3b7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.169381 Oct 27 09:37:27.139896 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 73/139] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:26 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:27.272037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:27.272858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:27.280822 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:27.281244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:27.281674 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:27.282380 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:27.282835 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:27.283257 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:27.440739 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:27.449007 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:27.451092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:27.452203 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-741d2857-9965-4d07-9908-1b492edf0e3b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.184526 Oct 27 09:37:27.469280 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 67/140] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:27 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:27.685805 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-fca4db81-f37f-47a2-8c6c-eb512ba73850 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:27.686406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-fca4db81-f37f-47a2-8c6c-eb512ba73850 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:27.692853 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fca4db81-f37f-47a2-8c6c-eb512ba73850 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:27.693615 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fca4db81-f37f-47a2-8c6c-eb512ba73850 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:27.694372 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fca4db81-f37f-47a2-8c6c-eb512ba73850 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:27.695267 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fca4db81-f37f-47a2-8c6c-eb512ba73850 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:27.696113 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fca4db81-f37f-47a2-8c6c-eb512ba73850 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:27.696745 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fca4db81-f37f-47a2-8c6c-eb512ba73850 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:27.722941 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5856686b-0a9a-4501-846f-8f68039c5e32 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:27.724574 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5856686b-0a9a-4501-846f-8f68039c5e32 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:27.734631 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5856686b-0a9a-4501-846f-8f68039c5e32 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:27.735551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5856686b-0a9a-4501-846f-8f68039c5e32 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:27.736644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5856686b-0a9a-4501-846f-8f68039c5e32 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:27.737663 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5856686b-0a9a-4501-846f-8f68039c5e32 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:27.738275 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5856686b-0a9a-4501-846f-8f68039c5e32 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:27.738920 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5856686b-0a9a-4501-846f-8f68039c5e32 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:27.887352 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-fca4db81-f37f-47a2-8c6c-eb512ba73850 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:27.896412 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-fca4db81-f37f-47a2-8c6c-eb512ba73850 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.215252 Oct 27 09:37:27.912126 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 74/141] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:27 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:27.918005 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5856686b-0a9a-4501-846f-8f68039c5e32 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:27.926611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5856686b-0a9a-4501-846f-8f68039c5e32 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.207319 Oct 27 09:37:27.927189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 68/142] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:27 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:28.162103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-67851198-e749-4362-b0a0-7e5ab5c52d11 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:28.162744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-67851198-e749-4362-b0a0-7e5ab5c52d11 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:28.168723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67851198-e749-4362-b0a0-7e5ab5c52d11 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.169203 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67851198-e749-4362-b0a0-7e5ab5c52d11 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.170696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67851198-e749-4362-b0a0-7e5ab5c52d11 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:28.171404 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67851198-e749-4362-b0a0-7e5ab5c52d11 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.171876 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67851198-e749-4362-b0a0-7e5ab5c52d11 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.172284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67851198-e749-4362-b0a0-7e5ab5c52d11 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:28.304278 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-67851198-e749-4362-b0a0-7e5ab5c52d11 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:28.311747 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-67851198-e749-4362-b0a0-7e5ab5c52d11 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.153483 Oct 27 09:37:28.312305 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 75/143] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:28 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:28.489726 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:28.490803 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:28.498638 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.499475 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.500499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:28.501501 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.502261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.502966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:28.677099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:28.680672 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:28.686700 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:28.688265 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:28.689459 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ce3537e2-125a-4ade-9ce7-62a28456f555 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.211550 Oct 27 09:37:28.690075 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 69/144] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:28 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:28.920760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b1bb3632-3659-4b6f-9b0d-d2bb36a17d6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:28.921341 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b1bb3632-3659-4b6f-9b0d-d2bb36a17d6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:28.927599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1bb3632-3659-4b6f-9b0d-d2bb36a17d6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.928085 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1bb3632-3659-4b6f-9b0d-d2bb36a17d6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.928542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1bb3632-3659-4b6f-9b0d-d2bb36a17d6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:28.929276 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1bb3632-3659-4b6f-9b0d-d2bb36a17d6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.929718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1bb3632-3659-4b6f-9b0d-d2bb36a17d6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.930136 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1bb3632-3659-4b6f-9b0d-d2bb36a17d6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:28.955886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a03cda5c-a6f2-449a-b0b7-7ea54b3c2f08 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:28.958584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a03cda5c-a6f2-449a-b0b7-7ea54b3c2f08 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:28.969755 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a03cda5c-a6f2-449a-b0b7-7ea54b3c2f08 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.971109 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a03cda5c-a6f2-449a-b0b7-7ea54b3c2f08 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.972004 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a03cda5c-a6f2-449a-b0b7-7ea54b3c2f08 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:28.973060 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a03cda5c-a6f2-449a-b0b7-7ea54b3c2f08 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:28.973719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a03cda5c-a6f2-449a-b0b7-7ea54b3c2f08 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:28.974636 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a03cda5c-a6f2-449a-b0b7-7ea54b3c2f08 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:29.237670 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a03cda5c-a6f2-449a-b0b7-7ea54b3c2f08 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:29.245425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a03cda5c-a6f2-449a-b0b7-7ea54b3c2f08 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.299182 Oct 27 09:37:29.249263 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 70/145] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:28 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:29.262930 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b1bb3632-3659-4b6f-9b0d-d2bb36a17d6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:29.272692 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b1bb3632-3659-4b6f-9b0d-d2bb36a17d6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.356274 Oct 27 09:37:29.272837 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 76/146] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:28 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:29.335977 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-af9c18b2-2deb-4f19-9465-8929ba264a6f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:29.336736 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-af9c18b2-2deb-4f19-9465-8929ba264a6f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:29.343140 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-af9c18b2-2deb-4f19-9465-8929ba264a6f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:29.343686 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-af9c18b2-2deb-4f19-9465-8929ba264a6f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:29.344206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-af9c18b2-2deb-4f19-9465-8929ba264a6f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:29.344979 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-af9c18b2-2deb-4f19-9465-8929ba264a6f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:29.345493 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-af9c18b2-2deb-4f19-9465-8929ba264a6f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:29.345977 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-af9c18b2-2deb-4f19-9465-8929ba264a6f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:29.528849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-af9c18b2-2deb-4f19-9465-8929ba264a6f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:29.538538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-af9c18b2-2deb-4f19-9465-8929ba264a6f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.207242 Oct 27 09:37:29.539183 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 71/147] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:29 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:29.722471 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:29.722471 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:29.722771 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:29.723125 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:29.723514 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:29.724397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:29.725049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:29.725642 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:29.860529 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:29.868635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:29.870076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:29.871181 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-aea0f1e1-553a-4220-942f-cdaec8288612 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.159629 Oct 27 09:37:29.872628 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 77/148] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:29 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:30.269135 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fa15e89c-b6da-4c87-b0b3-400c2efb7d23 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:30.269744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fa15e89c-b6da-4c87-b0b3-400c2efb7d23 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:30.276247 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fa15e89c-b6da-4c87-b0b3-400c2efb7d23 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.276984 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fa15e89c-b6da-4c87-b0b3-400c2efb7d23 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.277575 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fa15e89c-b6da-4c87-b0b3-400c2efb7d23 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:30.278948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fa15e89c-b6da-4c87-b0b3-400c2efb7d23 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.279433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fa15e89c-b6da-4c87-b0b3-400c2efb7d23 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.279868 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fa15e89c-b6da-4c87-b0b3-400c2efb7d23 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:30.297248 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-49f1429a-7a5f-4d9e-a8da-34509ab31bae tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:30.297925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-49f1429a-7a5f-4d9e-a8da-34509ab31bae tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:30.307607 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-49f1429a-7a5f-4d9e-a8da-34509ab31bae tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.308101 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-49f1429a-7a5f-4d9e-a8da-34509ab31bae tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.308591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-49f1429a-7a5f-4d9e-a8da-34509ab31bae tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:30.311258 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-49f1429a-7a5f-4d9e-a8da-34509ab31bae tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.311898 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-49f1429a-7a5f-4d9e-a8da-34509ab31bae tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.312469 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-49f1429a-7a5f-4d9e-a8da-34509ab31bae tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:30.538195 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-49f1429a-7a5f-4d9e-a8da-34509ab31bae tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:30.541617 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fa15e89c-b6da-4c87-b0b3-400c2efb7d23 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:30.545997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-49f1429a-7a5f-4d9e-a8da-34509ab31bae tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1314 microversion: 2.1 time: 0.254240 Oct 27 09:37:30.546691 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 78/149] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:30 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:30.551088 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fa15e89c-b6da-4c87-b0b3-400c2efb7d23 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.285885 Oct 27 09:37:30.551657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 72/150] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:30 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:30.569098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-00f6fb0b-0b5d-4131-8974-2c1bb4afd3b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:30.569705 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-00f6fb0b-0b5d-4131-8974-2c1bb4afd3b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:30.576610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-00f6fb0b-0b5d-4131-8974-2c1bb4afd3b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.577092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-00f6fb0b-0b5d-4131-8974-2c1bb4afd3b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.577513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-00f6fb0b-0b5d-4131-8974-2c1bb4afd3b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:30.578379 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-00f6fb0b-0b5d-4131-8974-2c1bb4afd3b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.578963 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-00f6fb0b-0b5d-4131-8974-2c1bb4afd3b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.579380 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-00f6fb0b-0b5d-4131-8974-2c1bb4afd3b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:30.712156 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-00f6fb0b-0b5d-4131-8974-2c1bb4afd3b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:30.720423 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-00f6fb0b-0b5d-4131-8974-2c1bb4afd3b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1321 microversion: 2.1 time: 0.162738 Oct 27 09:37:30.721020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 79/151] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:30 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:30.902348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:30.902952 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:30.908839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.909327 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.909762 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:30.910451 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:30.910996 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:30.911405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:31.038888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:31.047209 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:31.048785 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:31.049917 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-673b657e-bf8b-433e-93ce-cbb36d411567 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1407 microversion: 2.20 time: 0.151699 Oct 27 09:37:31.050702 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 73/152] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:30 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:31.584151 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-95855437-7c2f-453b-a81c-a33251ac65a4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:31.584151 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-95855437-7c2f-453b-a81c-a33251ac65a4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:31.584836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-07004612-946b-4574-8bff-5d89d7c2a91a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:31.584836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-07004612-946b-4574-8bff-5d89d7c2a91a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:31.608800 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95855437-7c2f-453b-a81c-a33251ac65a4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:31.612639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95855437-7c2f-453b-a81c-a33251ac65a4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:31.612914 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07004612-946b-4574-8bff-5d89d7c2a91a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:31.613524 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07004612-946b-4574-8bff-5d89d7c2a91a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:31.614250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07004612-946b-4574-8bff-5d89d7c2a91a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:31.616189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95855437-7c2f-453b-a81c-a33251ac65a4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:31.618015 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95855437-7c2f-453b-a81c-a33251ac65a4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:31.618639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95855437-7c2f-453b-a81c-a33251ac65a4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:31.620251 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07004612-946b-4574-8bff-5d89d7c2a91a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:31.622522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07004612-946b-4574-8bff-5d89d7c2a91a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:31.622906 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95855437-7c2f-453b-a81c-a33251ac65a4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:31.623977 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07004612-946b-4574-8bff-5d89d7c2a91a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:31.945670 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-95855437-7c2f-453b-a81c-a33251ac65a4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:31.953818 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-95855437-7c2f-453b-a81c-a33251ac65a4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1362 microversion: 2.1 time: 0.383436 Oct 27 09:37:31.957018 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 74/153] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:31 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:31.961705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e0483ccb-abfe-4ec5-8025-0e7b476c16a3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:31.962304 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e0483ccb-abfe-4ec5-8025-0e7b476c16a3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:31.978369 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e0483ccb-abfe-4ec5-8025-0e7b476c16a3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:31.978878 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e0483ccb-abfe-4ec5-8025-0e7b476c16a3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:31.979585 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e0483ccb-abfe-4ec5-8025-0e7b476c16a3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:31.979993 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-07004612-946b-4574-8bff-5d89d7c2a91a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:31.980321 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e0483ccb-abfe-4ec5-8025-0e7b476c16a3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:31.980856 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e0483ccb-abfe-4ec5-8025-0e7b476c16a3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:31.981449 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e0483ccb-abfe-4ec5-8025-0e7b476c16a3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:31.993198 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-07004612-946b-4574-8bff-5d89d7c2a91a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1500 microversion: 2.1 time: 0.427571 Oct 27 09:37:31.993668 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 80/154] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:31 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1500 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:32.078355 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:32.079242 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:32.090196 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.093627 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.095983 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.097200 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.099180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.100751 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.244293 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e0483ccb-abfe-4ec5-8025-0e7b476c16a3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:32.252592 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e0483ccb-abfe-4ec5-8025-0e7b476c16a3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1515 microversion: 2.1 time: 0.294302 Oct 27 09:37:32.253470 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 75/155] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:31 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1515 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:32.293330 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d7329cd7-a542-467e-bb34-8059aa1abd88 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:32.295720 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d7329cd7-a542-467e-bb34-8059aa1abd88 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:32.301686 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7329cd7-a542-467e-bb34-8059aa1abd88 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.302173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7329cd7-a542-467e-bb34-8059aa1abd88 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.302604 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7329cd7-a542-467e-bb34-8059aa1abd88 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.303306 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7329cd7-a542-467e-bb34-8059aa1abd88 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.303759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7329cd7-a542-467e-bb34-8059aa1abd88 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.304178 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7329cd7-a542-467e-bb34-8059aa1abd88 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.359549 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:32.370155 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:32.371602 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:32.373337 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d4ec3dde-d48e-48f1-ac5f-f8255df696b3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1599 microversion: 2.20 time: 0.300294 Oct 27 09:37:32.377227 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 81/156] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:37:32 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1599 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:37:32.393443 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-d7329cd7-a542-467e-bb34-8059aa1abd88 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lazy-loading 'flavor' on Instance uuid 9d7180c7-c669-4b10-b463-9910c0eebbdd {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:37:32.408115 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f94c0e8a-f86b-42f4-889c-b08d3566ec80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:32.408673 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f94c0e8a-f86b-42f4-889c-b08d3566ec80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:32.417697 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f94c0e8a-f86b-42f4-889c-b08d3566ec80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.418191 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f94c0e8a-f86b-42f4-889c-b08d3566ec80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.418622 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f94c0e8a-f86b-42f4-889c-b08d3566ec80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.420586 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f94c0e8a-f86b-42f4-889c-b08d3566ec80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.421059 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f94c0e8a-f86b-42f4-889c-b08d3566ec80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.421485 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f94c0e8a-f86b-42f4-889c-b08d3566ec80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.622961 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f94c0e8a-f86b-42f4-889c-b08d3566ec80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.219630 Oct 27 09:37:32.624246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 82/157] 10.222.0.70 () {60 vars in 1316 bytes} [Thu Oct 27 09:37:32 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:37:32.651964 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d7329cd7-a542-467e-bb34-8059aa1abd88 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd/action" status: 200 len: 32 microversion: 2.1 time: 0.372702 Oct 27 09:37:32.652956 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 76/158] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:37:32 2022] POST /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd/action => generated 32 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:37:32.664822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4dd9a234-5e6b-4da9-8610-633e0132dbd8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:32.665755 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4dd9a234-5e6b-4da9-8610-633e0132dbd8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:32.672576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dd9a234-5e6b-4da9-8610-633e0132dbd8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.673067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dd9a234-5e6b-4da9-8610-633e0132dbd8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.673561 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dd9a234-5e6b-4da9-8610-633e0132dbd8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.676726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dd9a234-5e6b-4da9-8610-633e0132dbd8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:32.676726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dd9a234-5e6b-4da9-8610-633e0132dbd8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:32.676726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dd9a234-5e6b-4da9-8610-633e0132dbd8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:32.869283 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4dd9a234-5e6b-4da9-8610-633e0132dbd8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:32.877878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4dd9a234-5e6b-4da9-8610-633e0132dbd8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.218228 Oct 27 09:37:32.878518 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 83/159] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:32 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:32.989742 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1164ac6d-41c4-4b27-a0bd-df6f78f51553 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:32.990826 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1164ac6d-41c4-4b27-a0bd-df6f78f51553 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:33.004041 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1164ac6d-41c4-4b27-a0bd-df6f78f51553 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:33.004549 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1164ac6d-41c4-4b27-a0bd-df6f78f51553 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:33.005118 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1164ac6d-41c4-4b27-a0bd-df6f78f51553 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:33.005823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1164ac6d-41c4-4b27-a0bd-df6f78f51553 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:33.006616 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1164ac6d-41c4-4b27-a0bd-df6f78f51553 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:33.007341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1164ac6d-41c4-4b27-a0bd-df6f78f51553 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:33.191490 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1164ac6d-41c4-4b27-a0bd-df6f78f51553 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:33.204786 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1164ac6d-41c4-4b27-a0bd-df6f78f51553 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1547 microversion: 2.1 time: 0.227825 Oct 27 09:37:33.207840 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 77/160] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:32 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1547 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:33.234567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-db84028b-9d9d-4960-b287-6b39a1d45355 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:33.235535 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-db84028b-9d9d-4960-b287-6b39a1d45355 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:33.244593 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db84028b-9d9d-4960-b287-6b39a1d45355 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:33.245564 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db84028b-9d9d-4960-b287-6b39a1d45355 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:33.249437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db84028b-9d9d-4960-b287-6b39a1d45355 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:33.250598 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db84028b-9d9d-4960-b287-6b39a1d45355 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:33.251301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db84028b-9d9d-4960-b287-6b39a1d45355 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:33.252026 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db84028b-9d9d-4960-b287-6b39a1d45355 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:33.425178 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-db84028b-9d9d-4960-b287-6b39a1d45355 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.195913 Oct 27 09:37:33.425791 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 84/161] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Oct 27 09:37:33 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:33.655378 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-62a092aa-edc2-4f53-ad8c-43fa3a677281 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17341528-fbe5-4ecc-88a0-2272f8051006"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:33.658996 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-62a092aa-edc2-4f53-ad8c-43fa3a677281 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:33.665896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-62a092aa-edc2-4f53-ad8c-43fa3a677281 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:33.667792 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-62a092aa-edc2-4f53-ad8c-43fa3a677281 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:33.668382 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-62a092aa-edc2-4f53-ad8c-43fa3a677281 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:33.669563 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-62a092aa-edc2-4f53-ad8c-43fa3a677281 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:33.670335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-62a092aa-edc2-4f53-ad8c-43fa3a677281 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:33.671208 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-62a092aa-edc2-4f53-ad8c-43fa3a677281 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:33.902629 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8e3ba4c7-313d-4409-8ffb-5fb35f66248f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:33.903251 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8e3ba4c7-313d-4409-8ffb-5fb35f66248f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:33.925376 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e3ba4c7-313d-4409-8ffb-5fb35f66248f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:33.926028 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e3ba4c7-313d-4409-8ffb-5fb35f66248f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:33.926476 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e3ba4c7-313d-4409-8ffb-5fb35f66248f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:33.927840 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e3ba4c7-313d-4409-8ffb-5fb35f66248f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:33.936591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e3ba4c7-313d-4409-8ffb-5fb35f66248f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:33.937601 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e3ba4c7-313d-4409-8ffb-5fb35f66248f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:34.204137 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-62a092aa-edc2-4f53-ad8c-43fa3a677281 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "POST /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553646 Oct 27 09:37:34.233123 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 78/162] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:37:33 2022] POST /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a/os-volume_attachments => generated 194 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:34.597843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-8e3ba4c7-313d-4409-8ffb-5fb35f66248f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:34.605634 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8e3ba4c7-313d-4409-8ffb-5fb35f66248f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.707739 Oct 27 09:37:34.606220 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 85/163] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:33 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:35.519047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-f40edaa5-aa64-4b9d-94a3-61248b30bf61 req-31d00d5c-20e3-4895-9800-6881e53c2a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5232c748-ed0e-4ba8-a76d-1b8b9ffd523c", "tag": "4aa69fa8-90ce-4e7e-909d-73d1c879dbeb"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:35.547240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=93 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:35.576401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-f40edaa5-aa64-4b9d-94a3-61248b30bf61 req-31d00d5c-20e3-4895-9800-6881e53c2a09 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:35.576989 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-f40edaa5-aa64-4b9d-94a3-61248b30bf61 req-31d00d5c-20e3-4895-9800-6881e53c2a09 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:35.577433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-f40edaa5-aa64-4b9d-94a3-61248b30bf61 req-31d00d5c-20e3-4895-9800-6881e53c2a09 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:35.629402 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-48968df8-5fef-4bf5-9937-b786605c0ce3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:35.629976 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-48968df8-5fef-4bf5-9937-b786605c0ce3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:35.637547 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-f40edaa5-aa64-4b9d-94a3-61248b30bf61 req-31d00d5c-20e3-4895-9800-6881e53c2a09 service nova] Creating event network-changed:4aa69fa8-90ce-4e7e-909d-73d1c879dbeb for instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c on hv-cinder-79797 Oct 27 09:37:35.643570 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48968df8-5fef-4bf5-9937-b786605c0ce3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:35.649521 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48968df8-5fef-4bf5-9937-b786605c0ce3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:35.650072 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48968df8-5fef-4bf5-9937-b786605c0ce3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:35.650964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48968df8-5fef-4bf5-9937-b786605c0ce3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:35.651446 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48968df8-5fef-4bf5-9937-b786605c0ce3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:35.651881 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48968df8-5fef-4bf5-9937-b786605c0ce3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:35.659106 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-f40edaa5-aa64-4b9d-94a3-61248b30bf61 req-31d00d5c-20e3-4895-9800-6881e53c2a09 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155492 Oct 27 09:37:35.660042 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 79/164] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:35.817501 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-6f8d2424-2727-4cf3-a004-1b00acb27959 req-0cc6683d-3b9e-4eb1-a12d-cc11ca11e503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac6a130-38c4-4843-b9a8-118d25c11c18", "tag": "0e6b0478-48aa-4f67-86d8-eb4b392e3971"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:35.860126 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6f8d2424-2727-4cf3-a004-1b00acb27959 req-0cc6683d-3b9e-4eb1-a12d-cc11ca11e503 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:35.860767 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6f8d2424-2727-4cf3-a004-1b00acb27959 req-0cc6683d-3b9e-4eb1-a12d-cc11ca11e503 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:35.861818 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6f8d2424-2727-4cf3-a004-1b00acb27959 req-0cc6683d-3b9e-4eb1-a12d-cc11ca11e503 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:35.900537 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-6f8d2424-2727-4cf3-a004-1b00acb27959 req-0cc6683d-3b9e-4eb1-a12d-cc11ca11e503 service nova] Creating event network-changed:0e6b0478-48aa-4f67-86d8-eb4b392e3971 for instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 on hv-cinder-79797 Oct 27 09:37:35.917686 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-6f8d2424-2727-4cf3-a004-1b00acb27959 req-0cc6683d-3b9e-4eb1-a12d-cc11ca11e503 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114824 Oct 27 09:37:35.918672 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 80/165] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:37:36.535391 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-48968df8-5fef-4bf5-9937-b786605c0ce3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:36.547568 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-48968df8-5fef-4bf5-9937-b786605c0ce3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.920683 Oct 27 09:37:36.549511 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 86/166] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:35 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:37.573424 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-393bb8b3-5880-4633-8031-2262a7400b87 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:37.574199 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-393bb8b3-5880-4633-8031-2262a7400b87 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:37.582521 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-393bb8b3-5880-4633-8031-2262a7400b87 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:37.583231 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-393bb8b3-5880-4633-8031-2262a7400b87 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:37.583807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-393bb8b3-5880-4633-8031-2262a7400b87 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:37.584915 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-393bb8b3-5880-4633-8031-2262a7400b87 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:37.586566 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-393bb8b3-5880-4633-8031-2262a7400b87 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:37.587173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-393bb8b3-5880-4633-8031-2262a7400b87 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:37.776093 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-393bb8b3-5880-4633-8031-2262a7400b87 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:37.784861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-393bb8b3-5880-4633-8031-2262a7400b87 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.217731 Oct 27 09:37:37.786512 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 81/167] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:37 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:38.814084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-570b34d0-5c97-463f-ab7b-a8be394d924f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:38.815823 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-570b34d0-5c97-463f-ab7b-a8be394d924f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:38.822308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=87 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:38.823724 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-570b34d0-5c97-463f-ab7b-a8be394d924f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:38.824340 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-570b34d0-5c97-463f-ab7b-a8be394d924f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:38.824814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-570b34d0-5c97-463f-ab7b-a8be394d924f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:38.826691 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-570b34d0-5c97-463f-ab7b-a8be394d924f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:38.827454 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-570b34d0-5c97-463f-ab7b-a8be394d924f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:38.827891 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-570b34d0-5c97-463f-ab7b-a8be394d924f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:38.996299 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-570b34d0-5c97-463f-ab7b-a8be394d924f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:39.005836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-570b34d0-5c97-463f-ab7b-a8be394d924f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.196986 Oct 27 09:37:39.007037 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 87/168] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:38 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:40.030400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-82632cdc-0686-43f2-a285-d87e0fa48799 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:40.031080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-82632cdc-0686-43f2-a285-d87e0fa48799 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:40.038757 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82632cdc-0686-43f2-a285-d87e0fa48799 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:40.039533 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82632cdc-0686-43f2-a285-d87e0fa48799 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:40.040069 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82632cdc-0686-43f2-a285-d87e0fa48799 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:40.040892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82632cdc-0686-43f2-a285-d87e0fa48799 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:40.041417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82632cdc-0686-43f2-a285-d87e0fa48799 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:40.041911 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82632cdc-0686-43f2-a285-d87e0fa48799 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:40.189567 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-82632cdc-0686-43f2-a285-d87e0fa48799 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:40.197581 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-82632cdc-0686-43f2-a285-d87e0fa48799 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.171337 Oct 27 09:37:40.198259 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 82/169] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:40 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:41.229631 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-428008b0-319f-4764-a7d6-1f97c0892777 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:41.230820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-428008b0-319f-4764-a7d6-1f97c0892777 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:41.237168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-428008b0-319f-4764-a7d6-1f97c0892777 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:41.237775 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-428008b0-319f-4764-a7d6-1f97c0892777 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:41.238328 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-428008b0-319f-4764-a7d6-1f97c0892777 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:41.239114 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-428008b0-319f-4764-a7d6-1f97c0892777 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:41.239791 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-428008b0-319f-4764-a7d6-1f97c0892777 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:41.240328 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-428008b0-319f-4764-a7d6-1f97c0892777 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:41.389361 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-428008b0-319f-4764-a7d6-1f97c0892777 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:41.398472 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-428008b0-319f-4764-a7d6-1f97c0892777 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.173301 Oct 27 09:37:41.399218 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 88/170] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:41 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:42.425951 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4368d710-8e64-49d0-8aaf-db68a2841731 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:42.426563 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4368d710-8e64-49d0-8aaf-db68a2841731 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:42.433191 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4368d710-8e64-49d0-8aaf-db68a2841731 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:42.433654 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4368d710-8e64-49d0-8aaf-db68a2841731 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:42.434080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4368d710-8e64-49d0-8aaf-db68a2841731 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:42.435040 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4368d710-8e64-49d0-8aaf-db68a2841731 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:42.435491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4368d710-8e64-49d0-8aaf-db68a2841731 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:42.435907 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4368d710-8e64-49d0-8aaf-db68a2841731 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:42.568342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4368d710-8e64-49d0-8aaf-db68a2841731 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:42.576509 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4368d710-8e64-49d0-8aaf-db68a2841731 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.154396 Oct 27 09:37:42.577102 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 83/171] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:42 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:43.181260 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-42be9b8a-66fc-43e5-873b-78af922cd3f6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:43.181868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-42be9b8a-66fc-43e5-873b-78af922cd3f6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:43.188608 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-42be9b8a-66fc-43e5-873b-78af922cd3f6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:43.189092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-42be9b8a-66fc-43e5-873b-78af922cd3f6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:43.189525 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-42be9b8a-66fc-43e5-873b-78af922cd3f6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:43.190279 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-42be9b8a-66fc-43e5-873b-78af922cd3f6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:43.190674 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-42be9b8a-66fc-43e5-873b-78af922cd3f6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:43.191111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-42be9b8a-66fc-43e5-873b-78af922cd3f6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:43.216506 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-42be9b8a-66fc-43e5-873b-78af922cd3f6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Going to try to terminate instance {{(pid=125361) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:37:43.221077 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:43.310749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-42be9b8a-66fc-43e5-873b-78af922cd3f6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "DELETE /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 204 len: 0 microversion: 2.1 time: 0.132750 Oct 27 09:37:43.311397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 89/172] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:37:43 2022] DELETE /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:37:43.319377 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8103684e-6a1d-4021-8968-a694481e6749 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:43.319993 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8103684e-6a1d-4021-8968-a694481e6749 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:43.326045 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8103684e-6a1d-4021-8968-a694481e6749 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:43.326527 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8103684e-6a1d-4021-8968-a694481e6749 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:43.326962 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8103684e-6a1d-4021-8968-a694481e6749 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:43.327644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8103684e-6a1d-4021-8968-a694481e6749 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:43.328100 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8103684e-6a1d-4021-8968-a694481e6749 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:43.328570 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8103684e-6a1d-4021-8968-a694481e6749 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:43.347272 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:37:43.458240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8103684e-6a1d-4021-8968-a694481e6749 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:43.466517 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8103684e-6a1d-4021-8968-a694481e6749 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1552 microversion: 2.1 time: 0.151015 Oct 27 09:37:43.467079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 84/173] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:43 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:43.599503 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6c94d0ae-db23-484a-9f13-1323f32111bf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:43.600193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6c94d0ae-db23-484a-9f13-1323f32111bf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:43.606063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c94d0ae-db23-484a-9f13-1323f32111bf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:43.607123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c94d0ae-db23-484a-9f13-1323f32111bf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:43.607587 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c94d0ae-db23-484a-9f13-1323f32111bf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:43.608264 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c94d0ae-db23-484a-9f13-1323f32111bf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:43.608745 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c94d0ae-db23-484a-9f13-1323f32111bf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:43.609164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c94d0ae-db23-484a-9f13-1323f32111bf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:43.740425 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6c94d0ae-db23-484a-9f13-1323f32111bf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:43.748487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6c94d0ae-db23-484a-9f13-1323f32111bf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.153140 Oct 27 09:37:43.749070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 90/174] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:43 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:44.489978 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9b67df3d-db5d-422a-b90c-1f99f7d76e6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:44.490597 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9b67df3d-db5d-422a-b90c-1f99f7d76e6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:44.497521 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9b67df3d-db5d-422a-b90c-1f99f7d76e6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:44.497999 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9b67df3d-db5d-422a-b90c-1f99f7d76e6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:44.498430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9b67df3d-db5d-422a-b90c-1f99f7d76e6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:44.499113 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9b67df3d-db5d-422a-b90c-1f99f7d76e6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:44.499570 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9b67df3d-db5d-422a-b90c-1f99f7d76e6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:44.499992 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9b67df3d-db5d-422a-b90c-1f99f7d76e6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:44.626101 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9b67df3d-db5d-422a-b90c-1f99f7d76e6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:44.634375 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9b67df3d-db5d-422a-b90c-1f99f7d76e6a tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1552 microversion: 2.1 time: 0.148243 Oct 27 09:37:44.634947 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 85/175] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:44 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:44.770935 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e5f92828-e426-4b7f-b3e0-89a497639c41 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:44.771549 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e5f92828-e426-4b7f-b3e0-89a497639c41 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:44.777517 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e5f92828-e426-4b7f-b3e0-89a497639c41 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:44.778001 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e5f92828-e426-4b7f-b3e0-89a497639c41 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:44.779068 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e5f92828-e426-4b7f-b3e0-89a497639c41 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:44.779749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e5f92828-e426-4b7f-b3e0-89a497639c41 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:44.780199 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e5f92828-e426-4b7f-b3e0-89a497639c41 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:44.780645 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e5f92828-e426-4b7f-b3e0-89a497639c41 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:44.904911 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e5f92828-e426-4b7f-b3e0-89a497639c41 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:44.912503 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e5f92828-e426-4b7f-b3e0-89a497639c41 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.145401 Oct 27 09:37:44.913091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 91/176] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:44 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:45.658312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0fcb2dac-a905-4cd7-abc7-d389c7ccd6d6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:45.658914 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0fcb2dac-a905-4cd7-abc7-d389c7ccd6d6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:45.665236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0fcb2dac-a905-4cd7-abc7-d389c7ccd6d6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:45.665711 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0fcb2dac-a905-4cd7-abc7-d389c7ccd6d6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:45.666150 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0fcb2dac-a905-4cd7-abc7-d389c7ccd6d6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:45.666826 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0fcb2dac-a905-4cd7-abc7-d389c7ccd6d6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:45.667264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0fcb2dac-a905-4cd7-abc7-d389c7ccd6d6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:45.667678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0fcb2dac-a905-4cd7-abc7-d389c7ccd6d6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:45.800207 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0fcb2dac-a905-4cd7-abc7-d389c7ccd6d6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:45.808618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0fcb2dac-a905-4cd7-abc7-d389c7ccd6d6 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1552 microversion: 2.1 time: 0.153965 Oct 27 09:37:45.809230 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 86/177] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:45 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:45.936270 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3ac3e481-d469-432b-8196-84e1630aa4f2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:45.937009 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3ac3e481-d469-432b-8196-84e1630aa4f2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:45.943487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3ac3e481-d469-432b-8196-84e1630aa4f2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:45.944050 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3ac3e481-d469-432b-8196-84e1630aa4f2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:45.944489 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3ac3e481-d469-432b-8196-84e1630aa4f2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:45.945230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3ac3e481-d469-432b-8196-84e1630aa4f2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:45.945676 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3ac3e481-d469-432b-8196-84e1630aa4f2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:45.946223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3ac3e481-d469-432b-8196-84e1630aa4f2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:46.082864 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3ac3e481-d469-432b-8196-84e1630aa4f2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:46.091845 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3ac3e481-d469-432b-8196-84e1630aa4f2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.160323 Oct 27 09:37:46.102438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 92/178] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:45 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:46.831986 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-cfb25ba9-e008-4e99-bf40-75bebed782df tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:46.832627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-cfb25ba9-e008-4e99-bf40-75bebed782df tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:46.839275 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfb25ba9-e008-4e99-bf40-75bebed782df tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:46.839812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfb25ba9-e008-4e99-bf40-75bebed782df tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:46.840290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfb25ba9-e008-4e99-bf40-75bebed782df tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:46.841605 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfb25ba9-e008-4e99-bf40-75bebed782df tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:46.842094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfb25ba9-e008-4e99-bf40-75bebed782df tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:46.842536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfb25ba9-e008-4e99-bf40-75bebed782df tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:46.974572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cfb25ba9-e008-4e99-bf40-75bebed782df tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:46.983261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-cfb25ba9-e008-4e99-bf40-75bebed782df tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1552 microversion: 2.1 time: 0.155495 Oct 27 09:37:46.983823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 87/179] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:46 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:47.115414 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-80e395d5-bf93-4ce8-af1e-fd2799a07438 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:47.116031 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-80e395d5-bf93-4ce8-af1e-fd2799a07438 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:47.122693 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80e395d5-bf93-4ce8-af1e-fd2799a07438 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:47.123270 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80e395d5-bf93-4ce8-af1e-fd2799a07438 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:47.123707 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80e395d5-bf93-4ce8-af1e-fd2799a07438 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:47.124670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80e395d5-bf93-4ce8-af1e-fd2799a07438 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:47.125143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80e395d5-bf93-4ce8-af1e-fd2799a07438 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:47.125701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80e395d5-bf93-4ce8-af1e-fd2799a07438 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:47.256666 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-80e395d5-bf93-4ce8-af1e-fd2799a07438 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:47.265152 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-80e395d5-bf93-4ce8-af1e-fd2799a07438 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.153722 Oct 27 09:37:47.265924 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 93/180] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:47 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:48.006572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-39a90b16-39c3-4a57-b2e0-e13ed6ecdb8d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:48.007336 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-39a90b16-39c3-4a57-b2e0-e13ed6ecdb8d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:48.014912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-39a90b16-39c3-4a57-b2e0-e13ed6ecdb8d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:48.015503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-39a90b16-39c3-4a57-b2e0-e13ed6ecdb8d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:48.016097 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-39a90b16-39c3-4a57-b2e0-e13ed6ecdb8d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:48.016894 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-39a90b16-39c3-4a57-b2e0-e13ed6ecdb8d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:48.017483 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-39a90b16-39c3-4a57-b2e0-e13ed6ecdb8d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:48.017993 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-39a90b16-39c3-4a57-b2e0-e13ed6ecdb8d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:48.227361 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-39a90b16-39c3-4a57-b2e0-e13ed6ecdb8d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:48.236272 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-39a90b16-39c3-4a57-b2e0-e13ed6ecdb8d tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1552 microversion: 2.1 time: 0.233721 Oct 27 09:37:48.236879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 88/181] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:48 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1552 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:48.289197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2d484b1f-31c7-4b1c-bf14-90206fec2ac9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:48.290188 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2d484b1f-31c7-4b1c-bf14-90206fec2ac9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:48.297087 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d484b1f-31c7-4b1c-bf14-90206fec2ac9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:48.297569 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d484b1f-31c7-4b1c-bf14-90206fec2ac9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:48.298000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d484b1f-31c7-4b1c-bf14-90206fec2ac9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:48.298690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d484b1f-31c7-4b1c-bf14-90206fec2ac9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:48.299143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d484b1f-31c7-4b1c-bf14-90206fec2ac9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:48.299562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d484b1f-31c7-4b1c-bf14-90206fec2ac9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:48.443947 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2d484b1f-31c7-4b1c-bf14-90206fec2ac9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:48.451762 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2d484b1f-31c7-4b1c-bf14-90206fec2ac9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.166803 Oct 27 09:37:48.452331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 94/182] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:48 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:49.259199 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3a56ee3c-d16b-4275-a01b-148222f81804 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:49.259810 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-3a56ee3c-d16b-4275-a01b-148222f81804 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:49.266247 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a56ee3c-d16b-4275-a01b-148222f81804 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:49.266726 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a56ee3c-d16b-4275-a01b-148222f81804 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:49.267161 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a56ee3c-d16b-4275-a01b-148222f81804 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:49.267867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a56ee3c-d16b-4275-a01b-148222f81804 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:49.268309 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a56ee3c-d16b-4275-a01b-148222f81804 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:49.268749 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a56ee3c-d16b-4275-a01b-148222f81804 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:49.404806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-3a56ee3c-d16b-4275-a01b-148222f81804 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:49.413272 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3a56ee3c-d16b-4275-a01b-148222f81804 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1552 microversion: 2.1 time: 0.157942 Oct 27 09:37:49.413894 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 89/183] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:49 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:49.475056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-640a0a32-7c3d-4c7e-8f2e-81401a271db6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:49.475657 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-640a0a32-7c3d-4c7e-8f2e-81401a271db6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:49.481979 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-640a0a32-7c3d-4c7e-8f2e-81401a271db6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:49.482451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-640a0a32-7c3d-4c7e-8f2e-81401a271db6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:49.482876 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-640a0a32-7c3d-4c7e-8f2e-81401a271db6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:49.483557 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-640a0a32-7c3d-4c7e-8f2e-81401a271db6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:49.484000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-640a0a32-7c3d-4c7e-8f2e-81401a271db6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:49.484405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-640a0a32-7c3d-4c7e-8f2e-81401a271db6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:49.617485 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-640a0a32-7c3d-4c7e-8f2e-81401a271db6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:49.627268 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-640a0a32-7c3d-4c7e-8f2e-81401a271db6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.155975 Oct 27 09:37:49.628995 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 95/184] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:49 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:50.438068 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2ec4f946-bfc5-4bad-bc52-c9c8d79fe2bf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:50.438588 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2ec4f946-bfc5-4bad-bc52-c9c8d79fe2bf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:50.445475 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ec4f946-bfc5-4bad-bc52-c9c8d79fe2bf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:50.446100 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ec4f946-bfc5-4bad-bc52-c9c8d79fe2bf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:50.446638 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ec4f946-bfc5-4bad-bc52-c9c8d79fe2bf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:50.447351 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ec4f946-bfc5-4bad-bc52-c9c8d79fe2bf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:50.447942 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ec4f946-bfc5-4bad-bc52-c9c8d79fe2bf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:50.448370 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2ec4f946-bfc5-4bad-bc52-c9c8d79fe2bf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:50.614717 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2ec4f946-bfc5-4bad-bc52-c9c8d79fe2bf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:50.623470 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2ec4f946-bfc5-4bad-bc52-c9c8d79fe2bf tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1552 microversion: 2.1 time: 0.190055 Oct 27 09:37:50.624047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 90/185] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:50 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1552 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:50.651522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4e6323a1-55cd-426b-9e17-41c04389510b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:50.652136 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4e6323a1-55cd-426b-9e17-41c04389510b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:50.658179 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e6323a1-55cd-426b-9e17-41c04389510b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:50.658658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e6323a1-55cd-426b-9e17-41c04389510b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:50.659092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e6323a1-55cd-426b-9e17-41c04389510b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:50.659778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e6323a1-55cd-426b-9e17-41c04389510b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:50.660231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e6323a1-55cd-426b-9e17-41c04389510b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:50.660691 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e6323a1-55cd-426b-9e17-41c04389510b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:50.852022 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4e6323a1-55cd-426b-9e17-41c04389510b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:50.864500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4e6323a1-55cd-426b-9e17-41c04389510b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.217001 Oct 27 09:37:50.865265 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 96/186] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:50 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:51.387102 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-b1650bf3-2f4f-4a10-a962-b39525965fc0 req-7377e7d3-7a00-4f42-9c9e-6d6f426496dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41afcd63-98f3-468b-a15d-f925bd7aba8a", "name": "network-vif-deleted", "tag": "88c31a6e-f135-454a-a1fa-282d832047fa"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:51.397234 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b1650bf3-2f4f-4a10-a962-b39525965fc0 req-7377e7d3-7a00-4f42-9c9e-6d6f426496dc service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.401224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b1650bf3-2f4f-4a10-a962-b39525965fc0 req-7377e7d3-7a00-4f42-9c9e-6d6f426496dc service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.401664 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b1650bf3-2f4f-4a10-a962-b39525965fc0 req-7377e7d3-7a00-4f42-9c9e-6d6f426496dc service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:51.414897 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-b1650bf3-2f4f-4a10-a962-b39525965fc0 req-7377e7d3-7a00-4f42-9c9e-6d6f426496dc service nova] Creating event network-vif-deleted:88c31a6e-f135-454a-a1fa-282d832047fa for instance 41afcd63-98f3-468b-a15d-f925bd7aba8a on hv-cinder-79797 Oct 27 09:37:51.421252 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-b1650bf3-2f4f-4a10-a962-b39525965fc0 req-7377e7d3-7a00-4f42-9c9e-6d6f426496dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037540 Oct 27 09:37:51.421867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 91/187] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:37:51.647206 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5f2c27b8-7c2f-440a-9f03-fd2fa2ae0096 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:51.647837 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5f2c27b8-7c2f-440a-9f03-fd2fa2ae0096 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:51.655193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5f2c27b8-7c2f-440a-9f03-fd2fa2ae0096 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.655759 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5f2c27b8-7c2f-440a-9f03-fd2fa2ae0096 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.657151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5f2c27b8-7c2f-440a-9f03-fd2fa2ae0096 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:51.658087 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5f2c27b8-7c2f-440a-9f03-fd2fa2ae0096 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.658897 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5f2c27b8-7c2f-440a-9f03-fd2fa2ae0096 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.659512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5f2c27b8-7c2f-440a-9f03-fd2fa2ae0096 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:51.731957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5f2c27b8-7c2f-440a-9f03-fd2fa2ae0096 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b8fa2a89eee41d09977d7c85c49707b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a417696418e34d1e9abaa74e3c5627e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:51.742099 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5f2c27b8-7c2f-440a-9f03-fd2fa2ae0096 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 200 len: 1345 microversion: 2.1 time: 0.098689 Oct 27 09:37:51.744610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 97/188] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:51 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 1345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:51.890880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ad6bf4ff-2e3e-4e7f-bf0a-60f81222636a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:51.891690 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ad6bf4ff-2e3e-4e7f-bf0a-60f81222636a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:51.898612 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad6bf4ff-2e3e-4e7f-bf0a-60f81222636a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.901338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad6bf4ff-2e3e-4e7f-bf0a-60f81222636a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.903304 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad6bf4ff-2e3e-4e7f-bf0a-60f81222636a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:51.904090 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad6bf4ff-2e3e-4e7f-bf0a-60f81222636a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:51.904987 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad6bf4ff-2e3e-4e7f-bf0a-60f81222636a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:51.905172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad6bf4ff-2e3e-4e7f-bf0a-60f81222636a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:52.090349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ad6bf4ff-2e3e-4e7f-bf0a-60f81222636a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:52.099889 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ad6bf4ff-2e3e-4e7f-bf0a-60f81222636a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.212979 Oct 27 09:37:52.100329 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 92/189] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:51 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:52.765585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:52.766733 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:52.772650 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:52.773132 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:52.773557 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:52.774248 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:52.774694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:52.775134 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:52.789250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] HTTP exception thrown: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Request method failure captured: Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a HTTP/1.1 Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEt42D0ansaqUaGiiFsk2062C5uKKHn4NpGFUhkpXw4PwXkbm44JHudSLbHGAcdM-NbtkbJqIH7riXmwOoYxszRwULo0MCdNX8Q0tA6R5HmqNjiYf06dbAxiE_6OBOSNH4l1zrJ8qGIa3WdxGudXsUyDQnfoCSd3mV_-9yxeSU0vWk Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: a417696418e34d1e9abaa74e3c5627e1 Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:37:52.794439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: a417696418e34d1e9abaa74e3c5627e1 Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-DeleteServersTestJSON-1805650151-project Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 6b8fa2a89eee41d09977d7c85c49707b Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-DeleteServersTestJSON-1805650151-project Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:52.795972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '41afcd63-98f3-468b-a15d-f925bd7aba8a'} Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:37:52.796774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:52.798111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:37:52.799437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Returning 404 to user: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:37:52.799437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4e2c2223-4d89-4827-a94e-5684977d1069 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 404 len: 111 microversion: 2.1 time: 0.034431 Oct 27 09:37:52.799437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 98/190] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:52 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:37:52.914229 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:52.917357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:52.926332 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:52.927452 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:52.927890 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:52.928632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:52.929083 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:52.929502 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:52.945164 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] HTTP exception thrown: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Request method failure captured: Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a/os-volume_attachments HTTP/1.1 Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEt42D0ansaqUaGiiFsk2062C5uKKHn4NpGFUhkpXw4PwXkbm44JHudSLbHGAcdM-NbtkbJqIH7riXmwOoYxszRwULo0MCdNX8Q0tA6R5HmqNjiYf06dbAxiE_6OBOSNH4l1zrJ8qGIa3WdxGudXsUyDQnfoCSd3mV_-9yxeSU0vWk Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: a417696418e34d1e9abaa74e3c5627e1 Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:37:52.949614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: a417696418e34d1e9abaa74e3c5627e1 Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-DeleteServersTestJSON-1805650151-project Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 6b8fa2a89eee41d09977d7c85c49707b Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-DeleteServersTestJSON-1805650151-project Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:52.951061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'server_id': '41afcd63-98f3-468b-a15d-f925bd7aba8a'} Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:37:52.951829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:52.953092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:52.954439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Returning 404 to user: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:37:52.954439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f82124fb-55a9-42d1-8078-b2ae25e80973 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040734 Oct 27 09:37:52.954439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 93/191] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:37:52 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:37:53.140789 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a398468d-6552-40ec-b6de-0f69c6e4eee5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:53.140789 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a398468d-6552-40ec-b6de-0f69c6e4eee5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:53.141093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a398468d-6552-40ec-b6de-0f69c6e4eee5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:53.142602 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a398468d-6552-40ec-b6de-0f69c6e4eee5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:53.143393 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a398468d-6552-40ec-b6de-0f69c6e4eee5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:53.144648 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a398468d-6552-40ec-b6de-0f69c6e4eee5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:53.145275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a398468d-6552-40ec-b6de-0f69c6e4eee5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:53.145923 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a398468d-6552-40ec-b6de-0f69c6e4eee5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:53.313604 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a398468d-6552-40ec-b6de-0f69c6e4eee5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:53.322109 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a398468d-6552-40ec-b6de-0f69c6e4eee5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.198817 Oct 27 09:37:53.323134 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 99/192] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:53 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:54.172344 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:54.173214 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:54.179270 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:54.179744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:54.180172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:54.180877 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:54.181324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:54.181738 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:54.349493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-114bc7a3-39b9-41ae-8441-df7d39015217 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:54.350676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] HTTP exception thrown: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:54.350881 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-114bc7a3-39b9-41ae-8441-df7d39015217 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Request method failure captured: Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: DELETE /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a HTTP/1.1 Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEt42D0ansaqUaGiiFsk2062C5uKKHn4NpGFUhkpXw4PwXkbm44JHudSLbHGAcdM-NbtkbJqIH7riXmwOoYxszRwULo0MCdNX8Q0tA6R5HmqNjiYf06dbAxiE_6OBOSNH4l1zrJ8qGIa3WdxGudXsUyDQnfoCSd3mV_-9yxeSU0vWk Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: a417696418e34d1e9abaa74e3c5627e1 Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:37:54.353014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: a417696418e34d1e9abaa74e3c5627e1 Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-DeleteServersTestJSON-1805650151-project Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 6b8fa2a89eee41d09977d7c85c49707b Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-DeleteServersTestJSON-1805650151-project Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:54.354179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '41afcd63-98f3-468b-a15d-f925bd7aba8a'} Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:37:54.354829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:54.357027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:54.358041 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Returning 404 to user: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:37:54.358041 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e6b6de78-213c-4640-810e-f0fc6e85251b tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "DELETE /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 404 len: 111 microversion: 2.1 time: 0.186407 Oct 27 09:37:54.358041 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 94/193] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:37:54 2022] DELETE /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:37:54.360119 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-114bc7a3-39b9-41ae-8441-df7d39015217 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:54.360635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-114bc7a3-39b9-41ae-8441-df7d39015217 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:54.361071 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-114bc7a3-39b9-41ae-8441-df7d39015217 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:54.361805 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-114bc7a3-39b9-41ae-8441-df7d39015217 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:54.362261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-114bc7a3-39b9-41ae-8441-df7d39015217 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:54.362686 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-114bc7a3-39b9-41ae-8441-df7d39015217 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:54.363700 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:54.364300 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] [instance: 41afcd63-98f3-468b-a15d-f925bd7aba8a] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:54.371368 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:54.372403 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:54.373202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:54.373927 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:54.374422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:54.374848 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:54.388673 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] HTTP exception thrown: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Request method failure captured: Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a HTTP/1.1 Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEt42D0ansaqUaGiiFsk2062C5uKKHn4NpGFUhkpXw4PwXkbm44JHudSLbHGAcdM-NbtkbJqIH7riXmwOoYxszRwULo0MCdNX8Q0tA6R5HmqNjiYf06dbAxiE_6OBOSNH4l1zrJ8qGIa3WdxGudXsUyDQnfoCSd3mV_-9yxeSU0vWk Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: a417696418e34d1e9abaa74e3c5627e1 Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:37:54.390251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a417696418e34d1e9abaa74e3c5627e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: a417696418e34d1e9abaa74e3c5627e1 Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-DeleteServersTestJSON-1805650151 Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-DeleteServersTestJSON-1805650151-project Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 6b8fa2a89eee41d09977d7c85c49707b Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-DeleteServersTestJSON-1805650151-project Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:54.391632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '41afcd63-98f3-468b-a15d-f925bd7aba8a'} Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:37:54.396358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. Oct 27 09:37:54.397807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:37:54.398976 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] Returning 404 to user: Instance 41afcd63-98f3-468b-a15d-f925bd7aba8a could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:37:54.398976 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-acd60fb6-142b-49e8-adb8-361a45fc8915 tempest-DeleteServersTestJSON-1805650151 tempest-DeleteServersTestJSON-1805650151-project] 10.222.0.70 "GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a" status: 404 len: 111 microversion: 2.1 time: 0.031867 Oct 27 09:37:54.398976 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 95/194] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:54 2022] GET /compute/v2.1/servers/41afcd63-98f3-468b-a15d-f925bd7aba8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:37:54.520509 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-114bc7a3-39b9-41ae-8441-df7d39015217 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:54.529895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-114bc7a3-39b9-41ae-8441-df7d39015217 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.185697 Oct 27 09:37:54.530732 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 100/195] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:54 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:55.553424 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c359f324-b421-4c55-a0ce-3ad1f0d4837e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:55.554078 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c359f324-b421-4c55-a0ce-3ad1f0d4837e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:55.581516 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c359f324-b421-4c55-a0ce-3ad1f0d4837e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:55.582459 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c359f324-b421-4c55-a0ce-3ad1f0d4837e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:55.582900 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c359f324-b421-4c55-a0ce-3ad1f0d4837e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:55.584883 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c359f324-b421-4c55-a0ce-3ad1f0d4837e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:55.596991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c359f324-b421-4c55-a0ce-3ad1f0d4837e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:55.597483 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c359f324-b421-4c55-a0ce-3ad1f0d4837e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:55.796634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c359f324-b421-4c55-a0ce-3ad1f0d4837e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:55.805072 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c359f324-b421-4c55-a0ce-3ad1f0d4837e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.255430 Oct 27 09:37:55.805669 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 96/196] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:55 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:56.830029 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b66a6d8e-b4d2-4f01-8a50-34d39e516fad tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:56.830894 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b66a6d8e-b4d2-4f01-8a50-34d39e516fad tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:56.847953 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b66a6d8e-b4d2-4f01-8a50-34d39e516fad tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:56.848459 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b66a6d8e-b4d2-4f01-8a50-34d39e516fad tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:56.848922 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b66a6d8e-b4d2-4f01-8a50-34d39e516fad tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:56.849632 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b66a6d8e-b4d2-4f01-8a50-34d39e516fad tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:56.850089 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b66a6d8e-b4d2-4f01-8a50-34d39e516fad tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:56.850510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b66a6d8e-b4d2-4f01-8a50-34d39e516fad tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:57.084411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b66a6d8e-b4d2-4f01-8a50-34d39e516fad tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:57.095417 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b66a6d8e-b4d2-4f01-8a50-34d39e516fad tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.270109 Oct 27 09:37:57.096004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 101/197] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:56 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:57.861040 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1691162744", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:37:57.937715 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] validate_networks() for None {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:37:58.119869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cc2949ac-9b08-4a73-829b-3485ba93e54f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:58.122092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cc2949ac-9b08-4a73-829b-3485ba93e54f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:58.130345 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc2949ac-9b08-4a73-829b-3485ba93e54f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:58.132175 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc2949ac-9b08-4a73-829b-3485ba93e54f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:58.136478 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc2949ac-9b08-4a73-829b-3485ba93e54f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:58.138108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc2949ac-9b08-4a73-829b-3485ba93e54f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:58.140463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc2949ac-9b08-4a73-829b-3485ba93e54f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:58.141113 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc2949ac-9b08-4a73-829b-3485ba93e54f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:58.537618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cc2949ac-9b08-4a73-829b-3485ba93e54f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:58.542522 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:37:58.543781 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:37:58.544388 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:37:58.544862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:37:58.545278 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:37:58.548322 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cc2949ac-9b08-4a73-829b-3485ba93e54f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.433329 Oct 27 09:37:58.551180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 102/198] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:58 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:58.561116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:58.561692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:58.562424 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:58.563511 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:58.564074 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:58.564505 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:58.585861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Getting quotas for project e694ff25532a41bfac762f1e11e3869c. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:37:58.591140 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Getting quotas for user c625f65762224ff9a799243ef0b527fc and project e694ff25532a41bfac762f1e11e3869c. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:37:58.608916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:37:58.613508 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:37:58.693790 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d237f4fa-91f5-4ee8-b84b-4eb0a75af644 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836415 Oct 27 09:37:58.694562 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 97/199] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:37:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:37:58.713907 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e77dddfe-5e76-4169-a69f-4f3e97d7a5b9 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:58.715687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e77dddfe-5e76-4169-a69f-4f3e97d7a5b9 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:58.785504 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e77dddfe-5e76-4169-a69f-4f3e97d7a5b9 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:58.802570 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e77dddfe-5e76-4169-a69f-4f3e97d7a5b9 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1215 microversion: 2.1 time: 0.093502 Oct 27 09:37:58.803702 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 103/200] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:58 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:37:59.573486 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4b78a694-760a-4c47-88c6-7c7418f76cef tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:59.574178 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4b78a694-760a-4c47-88c6-7c7418f76cef tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:59.582565 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b78a694-760a-4c47-88c6-7c7418f76cef tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:59.583061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b78a694-760a-4c47-88c6-7c7418f76cef tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:59.583503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b78a694-760a-4c47-88c6-7c7418f76cef tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:59.584212 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b78a694-760a-4c47-88c6-7c7418f76cef tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:59.584705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b78a694-760a-4c47-88c6-7c7418f76cef tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:59.585231 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b78a694-760a-4c47-88c6-7c7418f76cef tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:59.745817 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4b78a694-760a-4c47-88c6-7c7418f76cef tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:59.756877 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4b78a694-760a-4c47-88c6-7c7418f76cef tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.188861 Oct 27 09:37:59.757614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 98/201] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:59 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:37:59.826978 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ca1870a5-005e-47bd-bc55-eafc182efad8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:37:59.827588 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ca1870a5-005e-47bd-bc55-eafc182efad8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:37:59.835610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1870a5-005e-47bd-bc55-eafc182efad8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:59.836099 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1870a5-005e-47bd-bc55-eafc182efad8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:59.836557 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1870a5-005e-47bd-bc55-eafc182efad8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:59.837253 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1870a5-005e-47bd-bc55-eafc182efad8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:37:59.837708 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1870a5-005e-47bd-bc55-eafc182efad8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:37:59.838129 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1870a5-005e-47bd-bc55-eafc182efad8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:37:59.903037 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ca1870a5-005e-47bd-bc55-eafc182efad8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:37:59.915068 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ca1870a5-005e-47bd-bc55-eafc182efad8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1267 microversion: 2.1 time: 0.091880 Oct 27 09:37:59.915696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 104/202] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:37:59 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:00.781461 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-db487ce3-5362-4878-9bf4-6fc205157ad3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:00.782400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-db487ce3-5362-4878-9bf4-6fc205157ad3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:00.794171 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-db487ce3-5362-4878-9bf4-6fc205157ad3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:00.795186 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-db487ce3-5362-4878-9bf4-6fc205157ad3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:00.797393 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-db487ce3-5362-4878-9bf4-6fc205157ad3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:00.798929 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-db487ce3-5362-4878-9bf4-6fc205157ad3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:00.799397 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-db487ce3-5362-4878-9bf4-6fc205157ad3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:00.799848 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-db487ce3-5362-4878-9bf4-6fc205157ad3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:00.948976 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5510e6b1-5f43-4260-9dbe-4e9741f1d51f tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:00.949792 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5510e6b1-5f43-4260-9dbe-4e9741f1d51f tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:00.956017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5510e6b1-5f43-4260-9dbe-4e9741f1d51f tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:00.956506 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5510e6b1-5f43-4260-9dbe-4e9741f1d51f tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:00.956986 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5510e6b1-5f43-4260-9dbe-4e9741f1d51f tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:00.957706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5510e6b1-5f43-4260-9dbe-4e9741f1d51f tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:00.958157 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5510e6b1-5f43-4260-9dbe-4e9741f1d51f tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:00.958756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5510e6b1-5f43-4260-9dbe-4e9741f1d51f tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:01.056014 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5510e6b1-5f43-4260-9dbe-4e9741f1d51f tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:01.070125 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5510e6b1-5f43-4260-9dbe-4e9741f1d51f tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1273 microversion: 2.1 time: 0.132535 Oct 27 09:38:01.080631 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 105/203] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:00 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:01.097160 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-db487ce3-5362-4878-9bf4-6fc205157ad3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:01.108853 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-db487ce3-5362-4878-9bf4-6fc205157ad3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.333297 Oct 27 09:38:01.109759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 99/204] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:00 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:02.093445 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1622a69c-0f78-4278-adf7-6057dfd513a4 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:02.094058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1622a69c-0f78-4278-adf7-6057dfd513a4 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:02.103742 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1622a69c-0f78-4278-adf7-6057dfd513a4 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:02.104238 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1622a69c-0f78-4278-adf7-6057dfd513a4 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:02.104694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1622a69c-0f78-4278-adf7-6057dfd513a4 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:02.105954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1622a69c-0f78-4278-adf7-6057dfd513a4 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:02.106403 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1622a69c-0f78-4278-adf7-6057dfd513a4 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:02.112399 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1622a69c-0f78-4278-adf7-6057dfd513a4 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:02.138910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1444074f-f95e-4183-a104-342f0dc70379 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:02.139517 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1444074f-f95e-4183-a104-342f0dc70379 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:02.148454 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1444074f-f95e-4183-a104-342f0dc70379 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:02.149248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1444074f-f95e-4183-a104-342f0dc70379 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:02.149836 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1444074f-f95e-4183-a104-342f0dc70379 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:02.150686 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1444074f-f95e-4183-a104-342f0dc70379 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:02.151283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1444074f-f95e-4183-a104-342f0dc70379 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:02.151851 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1444074f-f95e-4183-a104-342f0dc70379 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:02.151997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:02.632473 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1444074f-f95e-4183-a104-342f0dc70379 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:02.670922 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1444074f-f95e-4183-a104-342f0dc70379 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.533749 Oct 27 09:38:02.677120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 100/205] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:02 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:02.689314 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1622a69c-0f78-4278-adf7-6057dfd513a4 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:02.698050 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1622a69c-0f78-4278-adf7-6057dfd513a4 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1315 microversion: 2.1 time: 0.608594 Oct 27 09:38:02.698617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 106/206] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:02 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:03.160625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-509e8788-f8b4-48a1-9ae9-c157afb60fee req-ba43d0a4-a5e8-4bce-bedf-fa66a97fbd18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48bbc228-8c96-411c-b18f-8358affb9d1e", "tag": "e0c20856-d86b-460a-a786-0e01edc89012"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:03.180951 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-509e8788-f8b4-48a1-9ae9-c157afb60fee req-ba43d0a4-a5e8-4bce-bedf-fa66a97fbd18 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:03.181436 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-509e8788-f8b4-48a1-9ae9-c157afb60fee req-ba43d0a4-a5e8-4bce-bedf-fa66a97fbd18 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:03.184908 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-509e8788-f8b4-48a1-9ae9-c157afb60fee req-ba43d0a4-a5e8-4bce-bedf-fa66a97fbd18 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:03.211171 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-509e8788-f8b4-48a1-9ae9-c157afb60fee req-ba43d0a4-a5e8-4bce-bedf-fa66a97fbd18 service nova] Creating event network-changed:e0c20856-d86b-460a-a786-0e01edc89012 for instance 48bbc228-8c96-411c-b18f-8358affb9d1e on hv-cinder-79797 Oct 27 09:38:03.218708 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-509e8788-f8b4-48a1-9ae9-c157afb60fee req-ba43d0a4-a5e8-4bce-bedf-fa66a97fbd18 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063172 Oct 27 09:38:03.219775 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 101/207] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:03.701392 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0da9befb-c7f1-4136-8456-ef8a69e4e050 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:03.703373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0da9befb-c7f1-4136-8456-ef8a69e4e050 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:03.723603 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5208854b-27c4-4d66-a02d-7e94d5018134 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:03.724454 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5208854b-27c4-4d66-a02d-7e94d5018134 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:03.726927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0da9befb-c7f1-4136-8456-ef8a69e4e050 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:03.732811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0da9befb-c7f1-4136-8456-ef8a69e4e050 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:03.733868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0da9befb-c7f1-4136-8456-ef8a69e4e050 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:03.734732 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5208854b-27c4-4d66-a02d-7e94d5018134 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:03.736159 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0da9befb-c7f1-4136-8456-ef8a69e4e050 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:03.736441 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5208854b-27c4-4d66-a02d-7e94d5018134 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:03.737857 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5208854b-27c4-4d66-a02d-7e94d5018134 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:03.739100 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0da9befb-c7f1-4136-8456-ef8a69e4e050 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:03.741067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0da9befb-c7f1-4136-8456-ef8a69e4e050 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:03.743710 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5208854b-27c4-4d66-a02d-7e94d5018134 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:03.744650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5208854b-27c4-4d66-a02d-7e94d5018134 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:03.745649 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5208854b-27c4-4d66-a02d-7e94d5018134 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:04.273908 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5208854b-27c4-4d66-a02d-7e94d5018134 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:04.288613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5208854b-27c4-4d66-a02d-7e94d5018134 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1315 microversion: 2.1 time: 0.569430 Oct 27 09:38:04.289385 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 102/208] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:03 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:04.384242 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0da9befb-c7f1-4136-8456-ef8a69e4e050 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:04.396748 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0da9befb-c7f1-4136-8456-ef8a69e4e050 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.702795 Oct 27 09:38:04.401034 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 107/209] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:03 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:05.314224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3604e052-ad97-4445-a985-2c401a2de799 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:05.315145 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-3604e052-ad97-4445-a985-2c401a2de799 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:05.333573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3604e052-ad97-4445-a985-2c401a2de799 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:05.336252 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3604e052-ad97-4445-a985-2c401a2de799 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:05.337631 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3604e052-ad97-4445-a985-2c401a2de799 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:05.341455 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3604e052-ad97-4445-a985-2c401a2de799 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:05.342928 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3604e052-ad97-4445-a985-2c401a2de799 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:05.344156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3604e052-ad97-4445-a985-2c401a2de799 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:05.428658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-28e7caee-85cc-4fbc-81ad-8a767f3b3208 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:05.430442 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-28e7caee-85cc-4fbc-81ad-8a767f3b3208 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:05.439997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28e7caee-85cc-4fbc-81ad-8a767f3b3208 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:05.440793 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28e7caee-85cc-4fbc-81ad-8a767f3b3208 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:05.441472 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28e7caee-85cc-4fbc-81ad-8a767f3b3208 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:05.442408 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28e7caee-85cc-4fbc-81ad-8a767f3b3208 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:05.443061 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28e7caee-85cc-4fbc-81ad-8a767f3b3208 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:05.443946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28e7caee-85cc-4fbc-81ad-8a767f3b3208 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:06.311988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-3604e052-ad97-4445-a985-2c401a2de799 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:06.321331 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3604e052-ad97-4445-a985-2c401a2de799 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1315 microversion: 2.1 time: 1.013869 Oct 27 09:38:06.331417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 103/210] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:05 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1315 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:06.345310 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-28e7caee-85cc-4fbc-81ad-8a767f3b3208 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:06.369658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-28e7caee-85cc-4fbc-81ad-8a767f3b3208 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.945242 Oct 27 09:38:06.371861 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 108/211] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:05 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:07.060084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6b102964-93e5-413c-9c88-40f8564148e4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: .version_select at 0x7f364949aa60>, body: {"keypair": {"name": "tempest-keypair-1672760961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfJiQrYsjkNrpZLsRZHjb7eU6Q8HvxwSyGhkSWBYwhSATei7w1Qkpc/luxGUC5wcnV/8CS0T1zkkHIZpRyo3d8xAv+N2plp2MZgZVTQ1GNgEmHosQw8gAFlgAlM7A59hA=="}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:07.073051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:07.097956 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-6b102964-93e5-413c-9c88-40f8564148e4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'key_pairs'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:38:07.107479 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-6b102964-93e5-413c-9c88-40f8564148e4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for user f7d2c6275669404db608d714baeb0065 and project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'key_pairs'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:38:07.147328 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6b102964-93e5-413c-9c88-40f8564148e4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.349809 Oct 27 09:38:07.150299 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 104/212] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Oct 27 09:38:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:07.366816 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9c307928-a58c-461c-971b-7ec429f6dc57 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:07.374596 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9c307928-a58c-461c-971b-7ec429f6dc57 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:07.383246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c307928-a58c-461c-971b-7ec429f6dc57 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:07.385430 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c307928-a58c-461c-971b-7ec429f6dc57 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:07.386671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c307928-a58c-461c-971b-7ec429f6dc57 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:07.389888 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c307928-a58c-461c-971b-7ec429f6dc57 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:07.390516 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c307928-a58c-461c-971b-7ec429f6dc57 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:07.392392 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c307928-a58c-461c-971b-7ec429f6dc57 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:07.395324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-dc22815b-9c04-44eb-8ae3-fce95feda3e8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:07.396045 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-dc22815b-9c04-44eb-8ae3-fce95feda3e8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:07.419894 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dc22815b-9c04-44eb-8ae3-fce95feda3e8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:07.420482 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dc22815b-9c04-44eb-8ae3-fce95feda3e8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:07.421029 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dc22815b-9c04-44eb-8ae3-fce95feda3e8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:07.422086 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dc22815b-9c04-44eb-8ae3-fce95feda3e8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:07.422644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dc22815b-9c04-44eb-8ae3-fce95feda3e8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:07.423444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dc22815b-9c04-44eb-8ae3-fce95feda3e8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:07.803425 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9c307928-a58c-461c-971b-7ec429f6dc57 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:07.823553 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9c307928-a58c-461c-971b-7ec429f6dc57 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1315 microversion: 2.1 time: 0.468824 Oct 27 09:38:07.834176 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 109/213] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:07 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:07.847722 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-dc22815b-9c04-44eb-8ae3-fce95feda3e8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:07.869526 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-dc22815b-9c04-44eb-8ae3-fce95feda3e8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.479327 Oct 27 09:38:07.888943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 105/214] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:07 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:08.864447 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4dc20d87-41c5-4fa4-993c-5a8a25997e84 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:08.865221 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4dc20d87-41c5-4fa4-993c-5a8a25997e84 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:08.870331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:08.872341 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:08.880139 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dc20d87-41c5-4fa4-993c-5a8a25997e84 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:08.880139 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dc20d87-41c5-4fa4-993c-5a8a25997e84 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:08.880139 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dc20d87-41c5-4fa4-993c-5a8a25997e84 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:08.880139 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dc20d87-41c5-4fa4-993c-5a8a25997e84 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:08.881909 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dc20d87-41c5-4fa4-993c-5a8a25997e84 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:08.881909 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4dc20d87-41c5-4fa4-993c-5a8a25997e84 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:08.911521 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8827fc38-71e2-4a63-b8d8-87def65db2a9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:08.913554 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8827fc38-71e2-4a63-b8d8-87def65db2a9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:08.921857 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:08.925784 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8827fc38-71e2-4a63-b8d8-87def65db2a9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:08.926348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8827fc38-71e2-4a63-b8d8-87def65db2a9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:08.926863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8827fc38-71e2-4a63-b8d8-87def65db2a9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:08.927639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8827fc38-71e2-4a63-b8d8-87def65db2a9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:08.928155 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8827fc38-71e2-4a63-b8d8-87def65db2a9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:08.928680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8827fc38-71e2-4a63-b8d8-87def65db2a9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:08.935150 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:09.108279 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4dc20d87-41c5-4fa4-993c-5a8a25997e84 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:09.117464 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4dc20d87-41c5-4fa4-993c-5a8a25997e84 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1315 microversion: 2.1 time: 0.258477 Oct 27 09:38:09.119742 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 110/215] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:08 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:09.126813 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-83604971", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15104d09-0e0f-4140-ae39-9239f083d338"}], "security_groups": [{"name": "tempest-securitygroup--1790116858"}], "key_name": "tempest-keypair-1672760961", "user_data": "}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:09.140476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8827fc38-71e2-4a63-b8d8-87def65db2a9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:09.150751 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8827fc38-71e2-4a63-b8d8-87def65db2a9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.244111 Oct 27 09:38:09.154556 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 106/216] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:08 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:09.165782 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1650278622", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "networks": [{"uuid": "88875056-5d66-411a-8e40-f81cbf49fe49"}]}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:09.252980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] validate_networks() for [('88875056-5d66-411a-8e40-f81cbf49fe49', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:38:09.413313 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.network.neutron [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] validate_networks() for [('15104d09-0e0f-4140-ae39-9239f083d338', None, None, None, None, None)] {{(pid=125361) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:38:10.092622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:38:10.093609 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:38:10.094242 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:38:10.094794 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:38:10.095362 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:38:10.105699 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:10.106396 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:10.106976 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:10.108125 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:10.108769 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:10.109576 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:10.114233 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Flavor limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:38:10.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Image limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:38:10.115110 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Flavor pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:38:10.115571 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Image pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:38:10.115915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:38:10.130510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:10.131416 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:10.131959 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:10.133989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:10.134559 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Getting quotas for project 9dc4fbf213f04cd7ab49abad693a1cf2. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:38:10.135018 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:10.136262 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:10.139697 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Getting quotas for user b4e4e3b5ce544725b1f4a439596314a8 and project 9dc4fbf213f04cd7ab49abad693a1cf2. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:38:10.154070 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:38:10.156466 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:38:10.163688 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:38:10.169171 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for user f7d2c6275669404db608d714baeb0065 and project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:38:10.191243 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Going to run 1 instances... {{(pid=125361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:38:10.194421 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:38:10.230532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c9ea7308-b9d0-4b07-a2a6-57ff3c1c727e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.070178 Oct 27 09:38:10.235519 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 107/217] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:38:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:38:10.246575 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-1fc8a939-db1a-4db9-873a-a8533b56e4d3 req-bad3f63f-0103-4729-8f4f-b39cb8939bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bbc228-8c96-411c-b18f-8358affb9d1e", "name": "network-vif-plugged", "status": "completed", "tag": "e0c20856-d86b-460a-a786-0e01edc89012"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:10.261659 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-1fc8a939-db1a-4db9-873a-a8533b56e4d3 req-bad3f63f-0103-4729-8f4f-b39cb8939bb5 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:10.262156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-1fc8a939-db1a-4db9-873a-a8533b56e4d3 req-bad3f63f-0103-4729-8f4f-b39cb8939bb5 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:10.262588 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-1fc8a939-db1a-4db9-873a-a8533b56e4d3 req-bad3f63f-0103-4729-8f4f-b39cb8939bb5 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:10.288083 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-260900c9-5b13-4054-84a3-8f8419ad208f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.164874 Oct 27 09:38:10.289117 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 111/218] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:38:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:38:10.293147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-1fc8a939-db1a-4db9-873a-a8533b56e4d3 req-bad3f63f-0103-4729-8f4f-b39cb8939bb5 service nova] Creating event network-vif-plugged:e0c20856-d86b-460a-a786-0e01edc89012 for instance 48bbc228-8c96-411c-b18f-8358affb9d1e on hv-cinder-79797 Oct 27 09:38:10.299244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-59d52d2a-939d-4233-93cc-55c849865102 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:10.300125 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-59d52d2a-939d-4233-93cc-55c849865102 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:10.300665 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-1fc8a939-db1a-4db9-873a-a8533b56e4d3 req-bad3f63f-0103-4729-8f4f-b39cb8939bb5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059697 Oct 27 09:38:10.301284 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 108/219] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:10.309422 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59d52d2a-939d-4233-93cc-55c849865102 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:10.310386 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59d52d2a-939d-4233-93cc-55c849865102 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:10.311059 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59d52d2a-939d-4233-93cc-55c849865102 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:10.315633 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-cca9661b-cf53-4247-a002-6073777d9265 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:10.316557 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-cca9661b-cf53-4247-a002-6073777d9265 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:10.317521 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59d52d2a-939d-4233-93cc-55c849865102 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:10.318360 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59d52d2a-939d-4233-93cc-55c849865102 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:10.319031 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-59d52d2a-939d-4233-93cc-55c849865102 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:10.333928 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cca9661b-cf53-4247-a002-6073777d9265 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:10.334772 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cca9661b-cf53-4247-a002-6073777d9265 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:10.335418 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cca9661b-cf53-4247-a002-6073777d9265 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:10.336469 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cca9661b-cf53-4247-a002-6073777d9265 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:10.337103 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cca9661b-cf53-4247-a002-6073777d9265 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:10.338413 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cca9661b-cf53-4247-a002-6073777d9265 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:10.766888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cca9661b-cf53-4247-a002-6073777d9265 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:10.781310 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-59d52d2a-939d-4233-93cc-55c849865102 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:10.782964 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-cca9661b-cf53-4247-a002-6073777d9265 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.480378 Oct 27 09:38:10.784128 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 109/220] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:10 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:10.822498 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-59d52d2a-939d-4233-93cc-55c849865102 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1315 microversion: 2.1 time: 0.532177 Oct 27 09:38:10.837983 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 112/221] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:10 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:10.837983 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-dfdae49b-f7ca-42e1-afb3-bfa615610600 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:10.837983 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-dfdae49b-f7ca-42e1-afb3-bfa615610600 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:10.838250 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-df93f733-7653-4637-b352-9b5e3d0130a6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:10.838250 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-df93f733-7653-4637-b352-9b5e3d0130a6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:10.917588 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-df93f733-7653-4637-b352-9b5e3d0130a6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:10.928098 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-df93f733-7653-4637-b352-9b5e3d0130a6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1219 microversion: 2.1 time: 0.142275 Oct 27 09:38:10.940551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 110/222] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:10 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1219 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:10.975522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-dfdae49b-f7ca-42e1-afb3-bfa615610600 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:10.989409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-dfdae49b-f7ca-42e1-afb3-bfa615610600 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1240 microversion: 2.1 time: 0.158679 Oct 27 09:38:10.990021 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 113/223] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:10 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1240 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:11.809223 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-35d224bd-7829-46ab-9e1b-a236a0b3afc5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:11.810650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-35d224bd-7829-46ab-9e1b-a236a0b3afc5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:11.820505 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35d224bd-7829-46ab-9e1b-a236a0b3afc5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:11.821302 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35d224bd-7829-46ab-9e1b-a236a0b3afc5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:11.821906 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35d224bd-7829-46ab-9e1b-a236a0b3afc5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:11.822779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35d224bd-7829-46ab-9e1b-a236a0b3afc5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:11.823413 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35d224bd-7829-46ab-9e1b-a236a0b3afc5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:11.824027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35d224bd-7829-46ab-9e1b-a236a0b3afc5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:11.849596 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e7c05737-6812-467e-90bd-d3057e248ab3 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:11.850357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e7c05737-6812-467e-90bd-d3057e248ab3 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:11.859873 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e7c05737-6812-467e-90bd-d3057e248ab3 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:11.860507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e7c05737-6812-467e-90bd-d3057e248ab3 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:11.861063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e7c05737-6812-467e-90bd-d3057e248ab3 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:11.861861 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e7c05737-6812-467e-90bd-d3057e248ab3 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:11.862418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e7c05737-6812-467e-90bd-d3057e248ab3 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:11.862932 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e7c05737-6812-467e-90bd-d3057e248ab3 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:12.141267 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-35d224bd-7829-46ab-9e1b-a236a0b3afc5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:12.152315 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-35d224bd-7829-46ab-9e1b-a236a0b3afc5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.347145 Oct 27 09:38:12.155407 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e7c05737-6812-467e-90bd-d3057e248ab3 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:12.168130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e7c05737-6812-467e-90bd-d3057e248ab3 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1315 microversion: 2.1 time: 0.322735 Oct 27 09:38:12.169347 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 111/224] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:11 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:12.172173 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 114/225] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:11 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:12.179119 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-34386b8e-0ab7-4c59-b9da-e0b8b8c88422 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:12.179734 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-34386b8e-0ab7-4c59-b9da-e0b8b8c88422 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:12.180858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4c97c01f-47b5-427f-a96e-b11e45356ab1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:12.181889 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4c97c01f-47b5-427f-a96e-b11e45356ab1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:12.189108 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c97c01f-47b5-427f-a96e-b11e45356ab1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:12.190171 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c97c01f-47b5-427f-a96e-b11e45356ab1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:12.190763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c97c01f-47b5-427f-a96e-b11e45356ab1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:12.192065 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c97c01f-47b5-427f-a96e-b11e45356ab1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:12.192772 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c97c01f-47b5-427f-a96e-b11e45356ab1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:12.193350 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c97c01f-47b5-427f-a96e-b11e45356ab1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:12.193468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34386b8e-0ab7-4c59-b9da-e0b8b8c88422 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:12.209838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34386b8e-0ab7-4c59-b9da-e0b8b8c88422 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:12.210561 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34386b8e-0ab7-4c59-b9da-e0b8b8c88422 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:12.213151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34386b8e-0ab7-4c59-b9da-e0b8b8c88422 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:12.216533 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34386b8e-0ab7-4c59-b9da-e0b8b8c88422 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:12.216975 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34386b8e-0ab7-4c59-b9da-e0b8b8c88422 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:12.548802 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4c97c01f-47b5-427f-a96e-b11e45356ab1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:12.567240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4c97c01f-47b5-427f-a96e-b11e45356ab1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1215 microversion: 2.1 time: 0.396471 Oct 27 09:38:12.567849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 112/226] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:12 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1215 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:12.578237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-34386b8e-0ab7-4c59-b9da-e0b8b8c88422 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:12.588263 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-34386b8e-0ab7-4c59-b9da-e0b8b8c88422 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1292 microversion: 2.1 time: 0.414826 Oct 27 09:38:12.589073 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 115/227] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:12 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1292 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:13.175820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f23aece0-a9cf-436a-80cc-9b53f6307607 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:13.176440 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f23aece0-a9cf-436a-80cc-9b53f6307607 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:13.184457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f23aece0-a9cf-436a-80cc-9b53f6307607 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:13.184871 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f23aece0-a9cf-436a-80cc-9b53f6307607 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:13.185285 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f23aece0-a9cf-436a-80cc-9b53f6307607 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:13.186117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f23aece0-a9cf-436a-80cc-9b53f6307607 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:13.186762 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f23aece0-a9cf-436a-80cc-9b53f6307607 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:13.187211 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f23aece0-a9cf-436a-80cc-9b53f6307607 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:13.199963 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9350152a-8c80-4125-8e70-f6720d875f4d tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:13.200663 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9350152a-8c80-4125-8e70-f6720d875f4d tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:13.217421 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9350152a-8c80-4125-8e70-f6720d875f4d tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:13.218245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9350152a-8c80-4125-8e70-f6720d875f4d tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:13.218870 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9350152a-8c80-4125-8e70-f6720d875f4d tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:13.219798 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9350152a-8c80-4125-8e70-f6720d875f4d tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:13.220452 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9350152a-8c80-4125-8e70-f6720d875f4d tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:13.223214 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9350152a-8c80-4125-8e70-f6720d875f4d tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:13.614254 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f23aece0-a9cf-436a-80cc-9b53f6307607 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:13.633513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f23aece0-a9cf-436a-80cc-9b53f6307607 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.461633 Oct 27 09:38:13.635083 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 113/228] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:13 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:13.641871 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-10d6148a-1964-4b2e-a606-42aa2ffb4a1c tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:13.644066 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-10d6148a-1964-4b2e-a606-42aa2ffb4a1c tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:13.662347 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10d6148a-1964-4b2e-a606-42aa2ffb4a1c tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:13.663055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10d6148a-1964-4b2e-a606-42aa2ffb4a1c tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:13.663891 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10d6148a-1964-4b2e-a606-42aa2ffb4a1c tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:13.664785 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10d6148a-1964-4b2e-a606-42aa2ffb4a1c tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:13.665579 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10d6148a-1964-4b2e-a606-42aa2ffb4a1c tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:13.666365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10d6148a-1964-4b2e-a606-42aa2ffb4a1c tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:13.678448 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9350152a-8c80-4125-8e70-f6720d875f4d tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:13.686671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9350152a-8c80-4125-8e70-f6720d875f4d tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1464 microversion: 2.1 time: 0.491824 Oct 27 09:38:13.689921 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 116/229] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:13 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1464 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:13.701628 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1f2f9a4d-217a-423d-a09a-caa3d8a256c7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:13.702427 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1f2f9a4d-217a-423d-a09a-caa3d8a256c7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:13.715074 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f2f9a4d-217a-423d-a09a-caa3d8a256c7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:13.715574 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f2f9a4d-217a-423d-a09a-caa3d8a256c7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:13.729263 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f2f9a4d-217a-423d-a09a-caa3d8a256c7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:13.730625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f2f9a4d-217a-423d-a09a-caa3d8a256c7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:13.731109 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f2f9a4d-217a-423d-a09a-caa3d8a256c7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:13.731541 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f2f9a4d-217a-423d-a09a-caa3d8a256c7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:13.875386 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1f2f9a4d-217a-423d-a09a-caa3d8a256c7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:13.884200 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1f2f9a4d-217a-423d-a09a-caa3d8a256c7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1298 microversion: 2.1 time: 0.193087 Oct 27 09:38:13.884804 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 117/230] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:13 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1298 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:13.890174 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-79d6929c-2a69-4126-bb42-91d88eac49a6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:13.891312 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-79d6929c-2a69-4126-bb42-91d88eac49a6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:13.892250 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-10d6148a-1964-4b2e-a606-42aa2ffb4a1c tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:13.898035 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79d6929c-2a69-4126-bb42-91d88eac49a6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:13.898726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79d6929c-2a69-4126-bb42-91d88eac49a6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:13.899302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79d6929c-2a69-4126-bb42-91d88eac49a6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:13.900168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79d6929c-2a69-4126-bb42-91d88eac49a6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:13.900811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79d6929c-2a69-4126-bb42-91d88eac49a6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:13.902056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79d6929c-2a69-4126-bb42-91d88eac49a6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:13.906099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-10d6148a-1964-4b2e-a606-42aa2ffb4a1c tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1271 microversion: 2.1 time: 0.269534 Oct 27 09:38:13.906796 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 114/231] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:13 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:13.950284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-79d6929c-2a69-4126-bb42-91d88eac49a6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Going to try to terminate instance {{(pid=125361) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:38:14.064117 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-79d6929c-2a69-4126-bb42-91d88eac49a6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 204 len: 0 microversion: 2.1 time: 0.177284 Oct 27 09:38:14.066460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 118/232] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:38:13 2022] DELETE /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:38:14.075267 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-10507b05-bd9c-4257-83f6-935e09c535f8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:14.077283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-10507b05-bd9c-4257-83f6-935e09c535f8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:14.087497 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10507b05-bd9c-4257-83f6-935e09c535f8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:14.088058 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10507b05-bd9c-4257-83f6-935e09c535f8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:14.088581 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10507b05-bd9c-4257-83f6-935e09c535f8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:14.090532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10507b05-bd9c-4257-83f6-935e09c535f8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:14.091763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10507b05-bd9c-4257-83f6-935e09c535f8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:14.092508 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10507b05-bd9c-4257-83f6-935e09c535f8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:14.406043 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-10507b05-bd9c-4257-83f6-935e09c535f8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:14.418221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-10507b05-bd9c-4257-83f6-935e09c535f8 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1470 microversion: 2.1 time: 0.348998 Oct 27 09:38:14.434310 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 115/233] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:14 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1470 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:14.660641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-95f378c1-068d-4183-954a-8b8d7b3c7972 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:14.661432 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-95f378c1-068d-4183-954a-8b8d7b3c7972 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:14.667562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95f378c1-068d-4183-954a-8b8d7b3c7972 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:14.668123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95f378c1-068d-4183-954a-8b8d7b3c7972 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:14.668665 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95f378c1-068d-4183-954a-8b8d7b3c7972 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:14.669450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95f378c1-068d-4183-954a-8b8d7b3c7972 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:14.669970 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95f378c1-068d-4183-954a-8b8d7b3c7972 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:14.670461 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95f378c1-068d-4183-954a-8b8d7b3c7972 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:14.909847 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c221074d-5db6-48f9-a7ad-6ede9cf75a16 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:14.910692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c221074d-5db6-48f9-a7ad-6ede9cf75a16 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:14.916476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c221074d-5db6-48f9-a7ad-6ede9cf75a16 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:14.916999 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c221074d-5db6-48f9-a7ad-6ede9cf75a16 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:14.917931 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c221074d-5db6-48f9-a7ad-6ede9cf75a16 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:14.918624 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c221074d-5db6-48f9-a7ad-6ede9cf75a16 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:14.919065 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c221074d-5db6-48f9-a7ad-6ede9cf75a16 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:14.919658 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c221074d-5db6-48f9-a7ad-6ede9cf75a16 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:15.169650 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-95f378c1-068d-4183-954a-8b8d7b3c7972 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:15.181584 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-95f378c1-068d-4183-954a-8b8d7b3c7972 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.525132 Oct 27 09:38:15.182872 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 119/234] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:14 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:15.187382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2b9f386a-c0c1-4131-b13e-70193f5db38d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:15.187984 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2b9f386a-c0c1-4131-b13e-70193f5db38d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:15.194108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2b9f386a-c0c1-4131-b13e-70193f5db38d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:15.194635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2b9f386a-c0c1-4131-b13e-70193f5db38d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:15.195085 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2b9f386a-c0c1-4131-b13e-70193f5db38d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:15.195762 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2b9f386a-c0c1-4131-b13e-70193f5db38d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:15.196392 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2b9f386a-c0c1-4131-b13e-70193f5db38d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:15.196846 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2b9f386a-c0c1-4131-b13e-70193f5db38d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:15.217559 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c221074d-5db6-48f9-a7ad-6ede9cf75a16 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:15.225308 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c221074d-5db6-48f9-a7ad-6ede9cf75a16 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1298 microversion: 2.1 time: 0.319366 Oct 27 09:38:15.226202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 116/235] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:14 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1298 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:15.312731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2b9f386a-c0c1-4131-b13e-70193f5db38d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:15.321119 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2b9f386a-c0c1-4131-b13e-70193f5db38d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1279 microversion: 2.1 time: 0.137191 Oct 27 09:38:15.321662 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 120/236] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:15 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1279 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:15.445455 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f76c1a5a-b1d4-42a9-b449-c826a84034a7 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:15.446264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f76c1a5a-b1d4-42a9-b449-c826a84034a7 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:15.453151 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f76c1a5a-b1d4-42a9-b449-c826a84034a7 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:15.453913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f76c1a5a-b1d4-42a9-b449-c826a84034a7 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:15.454609 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f76c1a5a-b1d4-42a9-b449-c826a84034a7 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:15.455474 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f76c1a5a-b1d4-42a9-b449-c826a84034a7 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:15.456111 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f76c1a5a-b1d4-42a9-b449-c826a84034a7 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:15.456559 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f76c1a5a-b1d4-42a9-b449-c826a84034a7 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:15.786052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f76c1a5a-b1d4-42a9-b449-c826a84034a7 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:15.795123 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f76c1a5a-b1d4-42a9-b449-c826a84034a7 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1470 microversion: 2.1 time: 0.355629 Oct 27 09:38:15.803955 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 117/237] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:15 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1470 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:16.207759 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6bc3ffe4-4007-4752-8ce7-0e7f639a393e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:16.209565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6bc3ffe4-4007-4752-8ce7-0e7f639a393e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:16.234540 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bc3ffe4-4007-4752-8ce7-0e7f639a393e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:16.235893 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bc3ffe4-4007-4752-8ce7-0e7f639a393e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:16.236683 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bc3ffe4-4007-4752-8ce7-0e7f639a393e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:16.237679 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bc3ffe4-4007-4752-8ce7-0e7f639a393e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:16.238293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bc3ffe4-4007-4752-8ce7-0e7f639a393e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:16.239244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bc3ffe4-4007-4752-8ce7-0e7f639a393e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:16.250746 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-12920812-90cb-4c36-9e29-65b91d1760e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:16.251608 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-12920812-90cb-4c36-9e29-65b91d1760e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:16.265719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-12920812-90cb-4c36-9e29-65b91d1760e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:16.267921 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-12920812-90cb-4c36-9e29-65b91d1760e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:16.269360 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-12920812-90cb-4c36-9e29-65b91d1760e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:16.270102 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-12920812-90cb-4c36-9e29-65b91d1760e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:16.272204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-12920812-90cb-4c36-9e29-65b91d1760e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:16.272748 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-12920812-90cb-4c36-9e29-65b91d1760e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:16.693815 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-12920812-90cb-4c36-9e29-65b91d1760e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:16.725229 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6bc3ffe4-4007-4752-8ce7-0e7f639a393e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:16.729278 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-12920812-90cb-4c36-9e29-65b91d1760e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1366 microversion: 2.1 time: 0.482661 Oct 27 09:38:16.733956 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6bc3ffe4-4007-4752-8ce7-0e7f639a393e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.531978 Oct 27 09:38:16.740296 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 121/238] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:16 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:16.749410 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-348767c2-ceb0-48d9-8dbe-7c8dda00d44b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:16.755811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-348767c2-ceb0-48d9-8dbe-7c8dda00d44b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:16.759193 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 118/239] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:16 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1366 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:16.774405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-348767c2-ceb0-48d9-8dbe-7c8dda00d44b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:16.774911 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-348767c2-ceb0-48d9-8dbe-7c8dda00d44b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:16.775351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-348767c2-ceb0-48d9-8dbe-7c8dda00d44b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:16.776074 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-348767c2-ceb0-48d9-8dbe-7c8dda00d44b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:16.777108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-348767c2-ceb0-48d9-8dbe-7c8dda00d44b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:16.777541 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-348767c2-ceb0-48d9-8dbe-7c8dda00d44b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:16.826053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2f9bf8f1-3a34-4fa5-84c7-6d6801e25ee6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:16.827226 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2f9bf8f1-3a34-4fa5-84c7-6d6801e25ee6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:16.835740 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2f9bf8f1-3a34-4fa5-84c7-6d6801e25ee6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:16.844899 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2f9bf8f1-3a34-4fa5-84c7-6d6801e25ee6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:16.845532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2f9bf8f1-3a34-4fa5-84c7-6d6801e25ee6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:16.846430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2f9bf8f1-3a34-4fa5-84c7-6d6801e25ee6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:16.846880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2f9bf8f1-3a34-4fa5-84c7-6d6801e25ee6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:16.847298 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2f9bf8f1-3a34-4fa5-84c7-6d6801e25ee6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:16.947306 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-348767c2-ceb0-48d9-8dbe-7c8dda00d44b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:16.959433 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-348767c2-ceb0-48d9-8dbe-7c8dda00d44b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1277 microversion: 2.1 time: 0.216563 Oct 27 09:38:16.974174 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 122/240] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:16 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:17.189195 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-0c1475a3-abbb-4df8-b988-1c23afb94a30 req-dffb0251-ac85-486b-8963-d6f4c268b53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48bbc228-8c96-411c-b18f-8358affb9d1e", "name": "network-vif-deleted", "tag": "e0c20856-d86b-460a-a786-0e01edc89012"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:17.203124 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2f9bf8f1-3a34-4fa5-84c7-6d6801e25ee6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c625f65762224ff9a799243ef0b527fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e694ff25532a41bfac762f1e11e3869c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:17.253635 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2f9bf8f1-3a34-4fa5-84c7-6d6801e25ee6 tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 200 len: 1470 microversion: 2.1 time: 0.427869 Oct 27 09:38:17.254531 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 119/241] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:16 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:17.264441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-0c1475a3-abbb-4df8-b988-1c23afb94a30 req-dffb0251-ac85-486b-8963-d6f4c268b53e service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:17.265575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-0c1475a3-abbb-4df8-b988-1c23afb94a30 req-dffb0251-ac85-486b-8963-d6f4c268b53e service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:17.266173 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-0c1475a3-abbb-4df8-b988-1c23afb94a30 req-dffb0251-ac85-486b-8963-d6f4c268b53e service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:17.301688 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:17.304278 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-0c1475a3-abbb-4df8-b988-1c23afb94a30 req-dffb0251-ac85-486b-8963-d6f4c268b53e service nova] Creating event network-vif-deleted:e0c20856-d86b-460a-a786-0e01edc89012 for instance 48bbc228-8c96-411c-b18f-8358affb9d1e on hv-cinder-79797 Oct 27 09:38:17.317630 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-0c1475a3-abbb-4df8-b988-1c23afb94a30 req-dffb0251-ac85-486b-8963-d6f4c268b53e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135243 Oct 27 09:38:17.333789 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 123/242] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:38:17.597397 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-5062c8e6-dece-4976-90c4-91c734dd74e0 req-90cf2989-1077-475b-a72c-a37ebb27c41a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03530ba9-438a-41c2-8e0c-72e90cc316cc", "tag": "f81ca8dc-6051-4c47-b0e0-cafd4fc292d1"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:17.626812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5062c8e6-dece-4976-90c4-91c734dd74e0 req-90cf2989-1077-475b-a72c-a37ebb27c41a service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:17.633634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5062c8e6-dece-4976-90c4-91c734dd74e0 req-90cf2989-1077-475b-a72c-a37ebb27c41a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:17.633634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5062c8e6-dece-4976-90c4-91c734dd74e0 req-90cf2989-1077-475b-a72c-a37ebb27c41a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:17.669078 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-5062c8e6-dece-4976-90c4-91c734dd74e0 req-90cf2989-1077-475b-a72c-a37ebb27c41a service nova] Creating event network-changed:f81ca8dc-6051-4c47-b0e0-cafd4fc292d1 for instance 03530ba9-438a-41c2-8e0c-72e90cc316cc on hv-cinder-79797 Oct 27 09:38:17.698920 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-5062c8e6-dece-4976-90c4-91c734dd74e0 req-90cf2989-1077-475b-a72c-a37ebb27c41a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104910 Oct 27 09:38:17.703578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 120/243] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:17.763623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-382c063a-0c5b-4530-b8d9-39ab73c7ff8f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:17.764350 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-382c063a-0c5b-4530-b8d9-39ab73c7ff8f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:17.781949 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8a0fc1db-af58-4329-8cbf-2803633ec601 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:17.788831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8a0fc1db-af58-4329-8cbf-2803633ec601 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:17.795080 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-382c063a-0c5b-4530-b8d9-39ab73c7ff8f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:17.795575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-382c063a-0c5b-4530-b8d9-39ab73c7ff8f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:17.796011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-382c063a-0c5b-4530-b8d9-39ab73c7ff8f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:17.796843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-382c063a-0c5b-4530-b8d9-39ab73c7ff8f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:17.797197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-382c063a-0c5b-4530-b8d9-39ab73c7ff8f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:17.797620 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-382c063a-0c5b-4530-b8d9-39ab73c7ff8f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:17.803494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a0fc1db-af58-4329-8cbf-2803633ec601 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:17.804325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a0fc1db-af58-4329-8cbf-2803633ec601 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:17.805129 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a0fc1db-af58-4329-8cbf-2803633ec601 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:17.806030 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a0fc1db-af58-4329-8cbf-2803633ec601 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:17.809024 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a0fc1db-af58-4329-8cbf-2803633ec601 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:17.811569 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a0fc1db-af58-4329-8cbf-2803633ec601 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:18.250163 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-382c063a-0c5b-4530-b8d9-39ab73c7ff8f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:18.262221 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-382c063a-0c5b-4530-b8d9-39ab73c7ff8f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.502316 Oct 27 09:38:18.277049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 124/244] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:17 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:18.294331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-70ffa09b-1a74-4869-8190-abd11aa72926 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:18.294980 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-70ffa09b-1a74-4869-8190-abd11aa72926 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:18.310585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-70ffa09b-1a74-4869-8190-abd11aa72926 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:18.311243 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-70ffa09b-1a74-4869-8190-abd11aa72926 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:18.311690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-70ffa09b-1a74-4869-8190-abd11aa72926 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:18.312472 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-70ffa09b-1a74-4869-8190-abd11aa72926 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:18.313578 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-70ffa09b-1a74-4869-8190-abd11aa72926 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:18.314014 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-70ffa09b-1a74-4869-8190-abd11aa72926 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:18.548606 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8a0fc1db-af58-4329-8cbf-2803633ec601 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:18.557438 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8a0fc1db-af58-4329-8cbf-2803633ec601 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1366 microversion: 2.1 time: 0.779606 Oct 27 09:38:18.558646 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 121/245] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:17 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1366 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:18.579547 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:18.580147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] [instance: 48bbc228-8c96-411c-b18f-8358affb9d1e] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:18.609016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:18.611709 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:18.612325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:18.613239 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:18.614670 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:18.615265 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:18.650001 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] HTTP exception thrown: Instance 48bbc228-8c96-411c-b18f-8358affb9d1e could not be found. Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Request method failure captured: Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e HTTP/1.1 Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlFzm79F6Z3teWxZAKMo23RQv9zo24NZNlZ2uHUzvVf5oqF2pDKkq6ZsIOaepJlF6V8PL6S01LJ5bZ-jsWp704kU0De4t5PEr1HZy7nVnLHdUlbXHjK5HL8bKTEBhvvVLPv1kectjvFX8k9PSdZlIyT3cl7RFu46ptpnToLoIuwIiLE Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: e694ff25532a41bfac762f1e11e3869c Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-VolumesNegativeTest-70440899 Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:38:18.652057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e694ff25532a41bfac762f1e11e3869c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e694ff25532a41bfac762f1e11e3869c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e694ff25532a41bfac762f1e11e3869c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e694ff25532a41bfac762f1e11e3869c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-VolumesNegativeTest-70440899 Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: e694ff25532a41bfac762f1e11e3869c Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-VolumesNegativeTest-70440899 Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-VolumesNegativeTest-70440899-project Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: c625f65762224ff9a799243ef0b527fc Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-VolumesNegativeTest-70440899-project Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 48bbc228-8c96-411c-b18f-8358affb9d1e could not be found. Oct 27 09:38:18.653678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '48bbc228-8c96-411c-b18f-8358affb9d1e'} Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48bbc228-8c96-411c-b18f-8358affb9d1e could not be found. Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:38:18.654544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48bbc228-8c96-411c-b18f-8358affb9d1e could not be found. Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48bbc228-8c96-411c-b18f-8358affb9d1e could not be found. Oct 27 09:38:18.655896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:38:18.657960 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] Returning 404 to user: Instance 48bbc228-8c96-411c-b18f-8358affb9d1e could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:38:18.658988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-95f7eb3a-6cbe-4bbc-a95c-5762ad6967cb tempest-VolumesNegativeTest-70440899 tempest-VolumesNegativeTest-70440899-project] 10.222.0.70 "GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e" status: 404 len: 111 microversion: 2.1 time: 0.099431 Oct 27 09:38:18.660036 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 122/246] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:18 2022] GET /compute/v2.1/servers/48bbc228-8c96-411c-b18f-8358affb9d1e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:38:18.838328 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-70ffa09b-1a74-4869-8190-abd11aa72926 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:18.858825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-70ffa09b-1a74-4869-8190-abd11aa72926 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.592740 Oct 27 09:38:18.859417 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 125/247] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:18 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:19.293111 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-34bfef4f-f49a-4dc3-beee-f074c8fa49fd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:19.294363 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-34bfef4f-f49a-4dc3-beee-f074c8fa49fd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:19.301450 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34bfef4f-f49a-4dc3-beee-f074c8fa49fd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:19.302325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34bfef4f-f49a-4dc3-beee-f074c8fa49fd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:19.302926 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34bfef4f-f49a-4dc3-beee-f074c8fa49fd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:19.303946 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34bfef4f-f49a-4dc3-beee-f074c8fa49fd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:19.304582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34bfef4f-f49a-4dc3-beee-f074c8fa49fd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:19.305367 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34bfef4f-f49a-4dc3-beee-f074c8fa49fd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:19.571622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-34bfef4f-f49a-4dc3-beee-f074c8fa49fd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:19.584923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-34bfef4f-f49a-4dc3-beee-f074c8fa49fd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.297300 Oct 27 09:38:19.596820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0909d7ea-0d2a-496d-bd6b-1ad8db7b3d6b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:19.596820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0909d7ea-0d2a-496d-bd6b-1ad8db7b3d6b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:19.599559 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0909d7ea-0d2a-496d-bd6b-1ad8db7b3d6b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:19.599949 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0909d7ea-0d2a-496d-bd6b-1ad8db7b3d6b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:19.600378 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0909d7ea-0d2a-496d-bd6b-1ad8db7b3d6b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:19.604176 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0909d7ea-0d2a-496d-bd6b-1ad8db7b3d6b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:19.604919 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 123/248] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:19 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:19.605307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0909d7ea-0d2a-496d-bd6b-1ad8db7b3d6b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:19.605888 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0909d7ea-0d2a-496d-bd6b-1ad8db7b3d6b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:19.827625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0909d7ea-0d2a-496d-bd6b-1ad8db7b3d6b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:19.837859 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-fc255e6a-75c2-49af-afa1-f7d328a69f74 req-23c0bee9-e6ea-465a-bb13-a72e89bd9447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acba3b76-8223-4305-80d8-e739b12c6fcf", "tag": "265c29a2-64eb-4729-84e0-8504919ac033"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:19.846613 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0909d7ea-0d2a-496d-bd6b-1ad8db7b3d6b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1366 microversion: 2.1 time: 0.262596 Oct 27 09:38:19.850793 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 126/249] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:19 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:19.854650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-fc255e6a-75c2-49af-afa1-f7d328a69f74 req-23c0bee9-e6ea-465a-bb13-a72e89bd9447 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:19.855129 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-fc255e6a-75c2-49af-afa1-f7d328a69f74 req-23c0bee9-e6ea-465a-bb13-a72e89bd9447 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:19.856565 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-fc255e6a-75c2-49af-afa1-f7d328a69f74 req-23c0bee9-e6ea-465a-bb13-a72e89bd9447 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:19.886547 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9c611f4b-0251-4ecc-97d2-c234c5aff375 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:19.887707 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9c611f4b-0251-4ecc-97d2-c234c5aff375 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:19.904903 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c611f4b-0251-4ecc-97d2-c234c5aff375 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:19.906369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c611f4b-0251-4ecc-97d2-c234c5aff375 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:19.916663 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c611f4b-0251-4ecc-97d2-c234c5aff375 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:19.916927 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-fc255e6a-75c2-49af-afa1-f7d328a69f74 req-23c0bee9-e6ea-465a-bb13-a72e89bd9447 service nova] Creating event network-changed:265c29a2-64eb-4729-84e0-8504919ac033 for instance acba3b76-8223-4305-80d8-e739b12c6fcf on hv-cinder-79797 Oct 27 09:38:19.919686 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c611f4b-0251-4ecc-97d2-c234c5aff375 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:19.921056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c611f4b-0251-4ecc-97d2-c234c5aff375 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:19.921905 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c611f4b-0251-4ecc-97d2-c234c5aff375 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:19.931191 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-fc255e6a-75c2-49af-afa1-f7d328a69f74 req-23c0bee9-e6ea-465a-bb13-a72e89bd9447 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097054 Oct 27 09:38:19.934699 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 124/250] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:38:20.132341 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9c611f4b-0251-4ecc-97d2-c234c5aff375 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:20.148773 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9c611f4b-0251-4ecc-97d2-c234c5aff375 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.269719 Oct 27 09:38:20.149369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 127/251] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:19 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:20.607794 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:20.613378 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1974d560-3080-4a67-a655-5fee89f48167 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:20.614283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1974d560-3080-4a67-a655-5fee89f48167 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:20.626973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1974d560-3080-4a67-a655-5fee89f48167 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:20.627465 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1974d560-3080-4a67-a655-5fee89f48167 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:20.627897 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1974d560-3080-4a67-a655-5fee89f48167 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:20.628632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1974d560-3080-4a67-a655-5fee89f48167 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:20.636072 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1974d560-3080-4a67-a655-5fee89f48167 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:20.636775 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1974d560-3080-4a67-a655-5fee89f48167 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:20.873135 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8f823bc4-209b-4284-bd2b-4602f42db561 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:20.874403 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8f823bc4-209b-4284-bd2b-4602f42db561 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:20.886290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:20.888209 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8f823bc4-209b-4284-bd2b-4602f42db561 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:20.888742 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8f823bc4-209b-4284-bd2b-4602f42db561 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:20.890345 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8f823bc4-209b-4284-bd2b-4602f42db561 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:20.892913 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8f823bc4-209b-4284-bd2b-4602f42db561 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:20.893693 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8f823bc4-209b-4284-bd2b-4602f42db561 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:20.893994 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8f823bc4-209b-4284-bd2b-4602f42db561 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:20.922086 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=18 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:20.981025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=8 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:21.206091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1974d560-3080-4a67-a655-5fee89f48167 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:21.234903 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1974d560-3080-4a67-a655-5fee89f48167 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.627839 Oct 27 09:38:21.235529 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 125/252] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:20 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:21.252411 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5975730c-722d-4fe2-a416-53d69d7c643f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:21.253301 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5975730c-722d-4fe2-a416-53d69d7c643f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:21.260598 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5975730c-722d-4fe2-a416-53d69d7c643f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:21.264121 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5975730c-722d-4fe2-a416-53d69d7c643f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:21.264880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5975730c-722d-4fe2-a416-53d69d7c643f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:21.266502 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5975730c-722d-4fe2-a416-53d69d7c643f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:21.267269 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5975730c-722d-4fe2-a416-53d69d7c643f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:21.268448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5975730c-722d-4fe2-a416-53d69d7c643f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:21.422378 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-8f823bc4-209b-4284-bd2b-4602f42db561 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:21.431186 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8f823bc4-209b-4284-bd2b-4602f42db561 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1366 microversion: 2.1 time: 0.562555 Oct 27 09:38:21.437530 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 128/253] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:20 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1366 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:21.544045 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5975730c-722d-4fe2-a416-53d69d7c643f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:21.554264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5975730c-722d-4fe2-a416-53d69d7c643f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.316036 Oct 27 09:38:21.573470 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 126/254] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:21 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:22.262128 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cb88f69c-d766-47c8-a003-5ccbb00d1bd2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:22.262749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cb88f69c-d766-47c8-a003-5ccbb00d1bd2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:22.278239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb88f69c-d766-47c8-a003-5ccbb00d1bd2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:22.280924 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb88f69c-d766-47c8-a003-5ccbb00d1bd2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:22.281499 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb88f69c-d766-47c8-a003-5ccbb00d1bd2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:22.295035 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb88f69c-d766-47c8-a003-5ccbb00d1bd2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:22.295756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb88f69c-d766-47c8-a003-5ccbb00d1bd2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:22.297429 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb88f69c-d766-47c8-a003-5ccbb00d1bd2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:22.458045 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-83fb600d-e7e2-4426-9108-454e03253806 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:22.458697 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-83fb600d-e7e2-4426-9108-454e03253806 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:22.476131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-83fb600d-e7e2-4426-9108-454e03253806 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:22.477030 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-83fb600d-e7e2-4426-9108-454e03253806 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:22.478649 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-83fb600d-e7e2-4426-9108-454e03253806 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:22.482902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-83fb600d-e7e2-4426-9108-454e03253806 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:22.483394 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-83fb600d-e7e2-4426-9108-454e03253806 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:22.483837 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-83fb600d-e7e2-4426-9108-454e03253806 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:22.488322 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:22.726310 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cb88f69c-d766-47c8-a003-5ccbb00d1bd2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:22.735828 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cb88f69c-d766-47c8-a003-5ccbb00d1bd2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.478112 Oct 27 09:38:22.740074 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 129/255] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:22 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:22.747396 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6be90593-40d6-4d1d-b4a7-561e1dde636d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:22.748388 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6be90593-40d6-4d1d-b4a7-561e1dde636d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:22.770588 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6be90593-40d6-4d1d-b4a7-561e1dde636d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:22.777108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6be90593-40d6-4d1d-b4a7-561e1dde636d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:22.780565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6be90593-40d6-4d1d-b4a7-561e1dde636d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:22.781475 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6be90593-40d6-4d1d-b4a7-561e1dde636d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:22.782023 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6be90593-40d6-4d1d-b4a7-561e1dde636d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:22.782524 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6be90593-40d6-4d1d-b4a7-561e1dde636d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:22.835298 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-83fb600d-e7e2-4426-9108-454e03253806 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:22.843220 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-83fb600d-e7e2-4426-9108-454e03253806 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1366 microversion: 2.1 time: 0.389350 Oct 27 09:38:22.846655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 127/256] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:22 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:23.584975 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6be90593-40d6-4d1d-b4a7-561e1dde636d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:23.593007 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6be90593-40d6-4d1d-b4a7-561e1dde636d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.851519 Oct 27 09:38:23.593591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 130/257] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:22 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:23.766760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-87e7b94f-318f-46d7-982d-b372ef1e4d3c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:23.768100 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-87e7b94f-318f-46d7-982d-b372ef1e4d3c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:23.778635 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87e7b94f-318f-46d7-982d-b372ef1e4d3c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:23.779460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87e7b94f-318f-46d7-982d-b372ef1e4d3c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:23.780324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87e7b94f-318f-46d7-982d-b372ef1e4d3c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:23.781390 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87e7b94f-318f-46d7-982d-b372ef1e4d3c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:23.782533 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87e7b94f-318f-46d7-982d-b372ef1e4d3c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:23.791303 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87e7b94f-318f-46d7-982d-b372ef1e4d3c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:23.870025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ebc3a3a1-0499-439f-b818-fb32a9ba37e6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:23.871170 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ebc3a3a1-0499-439f-b818-fb32a9ba37e6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:23.888269 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebc3a3a1-0499-439f-b818-fb32a9ba37e6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:23.900084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebc3a3a1-0499-439f-b818-fb32a9ba37e6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:23.903307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebc3a3a1-0499-439f-b818-fb32a9ba37e6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:23.905604 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebc3a3a1-0499-439f-b818-fb32a9ba37e6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:23.907997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebc3a3a1-0499-439f-b818-fb32a9ba37e6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:23.909350 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebc3a3a1-0499-439f-b818-fb32a9ba37e6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:24.387008 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-87e7b94f-318f-46d7-982d-b372ef1e4d3c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:24.395446 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-87e7b94f-318f-46d7-982d-b372ef1e4d3c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1521 microversion: 2.1 time: 0.633860 Oct 27 09:38:24.403821 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 128/258] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:23 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1521 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:24.408704 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-cedc4a6c-ad69-463d-ae22-a360b8b3819c req-72c1cfb0-e214-4aec-b289-53bc57bc3946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03530ba9-438a-41c2-8e0c-72e90cc316cc", "name": "network-vif-plugged", "status": "completed", "tag": "f81ca8dc-6051-4c47-b0e0-cafd4fc292d1"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:24.433387 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-cedc4a6c-ad69-463d-ae22-a360b8b3819c req-72c1cfb0-e214-4aec-b289-53bc57bc3946 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:24.434116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-cedc4a6c-ad69-463d-ae22-a360b8b3819c req-72c1cfb0-e214-4aec-b289-53bc57bc3946 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:24.434773 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-cedc4a6c-ad69-463d-ae22-a360b8b3819c req-72c1cfb0-e214-4aec-b289-53bc57bc3946 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:24.467980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-cedc4a6c-ad69-463d-ae22-a360b8b3819c req-72c1cfb0-e214-4aec-b289-53bc57bc3946 service nova] Creating event network-vif-plugged:f81ca8dc-6051-4c47-b0e0-cafd4fc292d1 for instance 03530ba9-438a-41c2-8e0c-72e90cc316cc on hv-cinder-79797 Oct 27 09:38:24.474899 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-cedc4a6c-ad69-463d-ae22-a360b8b3819c req-72c1cfb0-e214-4aec-b289-53bc57bc3946 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069507 Oct 27 09:38:24.476108 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 129/259] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:24.522412 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ebc3a3a1-0499-439f-b818-fb32a9ba37e6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:24.543744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ebc3a3a1-0499-439f-b818-fb32a9ba37e6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1366 microversion: 2.1 time: 0.678151 Oct 27 09:38:24.544343 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 131/260] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:23 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1366 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:24.619700 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-377999cf-367a-41ce-906a-35174a7f74ce tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:24.621574 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-377999cf-367a-41ce-906a-35174a7f74ce tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:24.628290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-377999cf-367a-41ce-906a-35174a7f74ce tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:24.629031 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-377999cf-367a-41ce-906a-35174a7f74ce tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:24.630341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-377999cf-367a-41ce-906a-35174a7f74ce tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:24.631461 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-377999cf-367a-41ce-906a-35174a7f74ce tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:24.632067 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-377999cf-367a-41ce-906a-35174a7f74ce tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:24.632660 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-377999cf-367a-41ce-906a-35174a7f74ce tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:25.008830 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-377999cf-367a-41ce-906a-35174a7f74ce tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:25.020307 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-377999cf-367a-41ce-906a-35174a7f74ce tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.408350 Oct 27 09:38:25.045926 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 130/261] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:24 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:25.432982 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5a1cad44-a07b-4a07-9805-ebbae8142984 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:25.433574 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5a1cad44-a07b-4a07-9805-ebbae8142984 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:25.450857 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5a1cad44-a07b-4a07-9805-ebbae8142984 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:25.451530 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5a1cad44-a07b-4a07-9805-ebbae8142984 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:25.452170 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5a1cad44-a07b-4a07-9805-ebbae8142984 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:25.453062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5a1cad44-a07b-4a07-9805-ebbae8142984 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:25.453661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5a1cad44-a07b-4a07-9805-ebbae8142984 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:25.454498 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5a1cad44-a07b-4a07-9805-ebbae8142984 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:25.580803 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f6f84f62-8acd-45bf-a29f-fb2b3c30580d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:25.581458 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f6f84f62-8acd-45bf-a29f-fb2b3c30580d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:25.598564 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f6f84f62-8acd-45bf-a29f-fb2b3c30580d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:25.599559 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f6f84f62-8acd-45bf-a29f-fb2b3c30580d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:25.601151 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f6f84f62-8acd-45bf-a29f-fb2b3c30580d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:25.602357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f6f84f62-8acd-45bf-a29f-fb2b3c30580d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:25.603012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f6f84f62-8acd-45bf-a29f-fb2b3c30580d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:25.604085 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f6f84f62-8acd-45bf-a29f-fb2b3c30580d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:25.739951 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5a1cad44-a07b-4a07-9805-ebbae8142984 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:25.749422 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5a1cad44-a07b-4a07-9805-ebbae8142984 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1501 microversion: 2.1 time: 0.321770 Oct 27 09:38:25.751022 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 132/262] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:25 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1501 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:25.774839 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e4e41d14-2271-4a43-99c2-a97ee9d1140a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:25.775574 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e4e41d14-2271-4a43-99c2-a97ee9d1140a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:25.784357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4e41d14-2271-4a43-99c2-a97ee9d1140a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:25.784843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4e41d14-2271-4a43-99c2-a97ee9d1140a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:25.785270 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4e41d14-2271-4a43-99c2-a97ee9d1140a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:25.792311 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4e41d14-2271-4a43-99c2-a97ee9d1140a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:25.793353 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4e41d14-2271-4a43-99c2-a97ee9d1140a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:25.794044 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e4e41d14-2271-4a43-99c2-a97ee9d1140a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:26.043036 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f6f84f62-8acd-45bf-a29f-fb2b3c30580d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:26.062797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f6f84f62-8acd-45bf-a29f-fb2b3c30580d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1366 microversion: 2.1 time: 0.498771 Oct 27 09:38:26.066509 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 131/263] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:25 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1366 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:26.088022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-81cc0c45-287f-46ae-a470-e54a1f6a2f14 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:26.091152 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-81cc0c45-287f-46ae-a470-e54a1f6a2f14 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:26.099420 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e4e41d14-2271-4a43-99c2-a97ee9d1140a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:26.111517 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81cc0c45-287f-46ae-a470-e54a1f6a2f14 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:26.112016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81cc0c45-287f-46ae-a470-e54a1f6a2f14 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:26.112457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81cc0c45-287f-46ae-a470-e54a1f6a2f14 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:26.113230 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81cc0c45-287f-46ae-a470-e54a1f6a2f14 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:26.113690 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81cc0c45-287f-46ae-a470-e54a1f6a2f14 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:26.114294 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81cc0c45-287f-46ae-a470-e54a1f6a2f14 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:26.124343 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e4e41d14-2271-4a43-99c2-a97ee9d1140a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1516 microversion: 2.1 time: 0.352290 Oct 27 09:38:26.126275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 133/264] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:25 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1516 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:26.443456 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-81cc0c45-287f-46ae-a470-e54a1f6a2f14 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:26.452886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-81cc0c45-287f-46ae-a470-e54a1f6a2f14 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.383607 Oct 27 09:38:26.458178 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 132/265] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:26 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:27.077510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1db5cf15-a59a-48fe-9a7e-b9b8eb40b3f5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Action: 'create', calling method: .version_select at 0x7f3649528a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1429495316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGfZQKIuBCzRMfnVT/BHVf3ogikKFQN3Ahcrq4AW9OjPPz3iCcf6K3/9ncO1o9CcIkuhsQCrQc9Jd+JXs+HghFh0xuatk43RN7dYruxnTtOc5OVmta9r+wiqfsY+d5rUw=="}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:27.093958 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-1db5cf15-a59a-48fe-9a7e-b9b8eb40b3f5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Getting quotas for project f7b8fb656ee34fae8d20679c0e0f7ff9. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:38:27.095036 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2a7481a1-0556-4b84-bf4a-0f5e770203b5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:27.095653 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2a7481a1-0556-4b84-bf4a-0f5e770203b5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:27.098120 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-1db5cf15-a59a-48fe-9a7e-b9b8eb40b3f5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Getting quotas for user 0968b48cb99d4168b36a2602bd87f788 and project f7b8fb656ee34fae8d20679c0e0f7ff9. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:38:27.102176 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a7481a1-0556-4b84-bf4a-0f5e770203b5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:27.102663 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a7481a1-0556-4b84-bf4a-0f5e770203b5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:27.103099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a7481a1-0556-4b84-bf4a-0f5e770203b5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:27.103790 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a7481a1-0556-4b84-bf4a-0f5e770203b5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:27.104838 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a7481a1-0556-4b84-bf4a-0f5e770203b5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:27.105265 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a7481a1-0556-4b84-bf4a-0f5e770203b5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:27.120687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1db5cf15-a59a-48fe-9a7e-b9b8eb40b3f5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.207869 Oct 27 09:38:27.121452 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 134/266] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Oct 27 09:38:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:27.480906 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1f3ee017-05ba-41a7-b3e0-4303c1dd25bc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:27.482046 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1f3ee017-05ba-41a7-b3e0-4303c1dd25bc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:27.490173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2a7481a1-0556-4b84-bf4a-0f5e770203b5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:27.494969 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f3ee017-05ba-41a7-b3e0-4303c1dd25bc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:27.495670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f3ee017-05ba-41a7-b3e0-4303c1dd25bc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:27.496283 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f3ee017-05ba-41a7-b3e0-4303c1dd25bc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:27.497195 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f3ee017-05ba-41a7-b3e0-4303c1dd25bc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:27.497833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f3ee017-05ba-41a7-b3e0-4303c1dd25bc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:27.498502 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f3ee017-05ba-41a7-b3e0-4303c1dd25bc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:27.498677 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2a7481a1-0556-4b84-bf4a-0f5e770203b5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1366 microversion: 2.1 time: 0.407328 Oct 27 09:38:27.499261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 133/267] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:27 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:27.655323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1f3ee017-05ba-41a7-b3e0-4303c1dd25bc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:27.673563 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1f3ee017-05ba-41a7-b3e0-4303c1dd25bc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.197940 Oct 27 09:38:27.685972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 135/268] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:27 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:28.523717 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9bce68a6-1a8e-4498-9215-ba000ba1dd25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:28.524858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9bce68a6-1a8e-4498-9215-ba000ba1dd25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:28.534631 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9bce68a6-1a8e-4498-9215-ba000ba1dd25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:28.535273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9bce68a6-1a8e-4498-9215-ba000ba1dd25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:28.536104 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9bce68a6-1a8e-4498-9215-ba000ba1dd25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:28.537101 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9bce68a6-1a8e-4498-9215-ba000ba1dd25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:28.538774 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9bce68a6-1a8e-4498-9215-ba000ba1dd25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:28.539309 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9bce68a6-1a8e-4498-9215-ba000ba1dd25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:28.697947 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-de3d0a04-4ad4-4335-bdb2-09da0b7adc5f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:28.699366 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-de3d0a04-4ad4-4335-bdb2-09da0b7adc5f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:28.707580 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de3d0a04-4ad4-4335-bdb2-09da0b7adc5f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:28.708638 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de3d0a04-4ad4-4335-bdb2-09da0b7adc5f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:28.709944 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de3d0a04-4ad4-4335-bdb2-09da0b7adc5f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:28.711146 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de3d0a04-4ad4-4335-bdb2-09da0b7adc5f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:28.711793 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de3d0a04-4ad4-4335-bdb2-09da0b7adc5f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:28.712573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de3d0a04-4ad4-4335-bdb2-09da0b7adc5f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:28.744213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9bce68a6-1a8e-4498-9215-ba000ba1dd25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:28.756596 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9bce68a6-1a8e-4498-9215-ba000ba1dd25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1366 microversion: 2.1 time: 0.236305 Oct 27 09:38:28.772544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 134/269] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:28 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:28.826855 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-208b29fb-dd9f-4cf4-9d50-5a354c894620 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:28.833359 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-208b29fb-dd9f-4cf4-9d50-5a354c894620 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:28.843435 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-208b29fb-dd9f-4cf4-9d50-5a354c894620 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:28.844281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-208b29fb-dd9f-4cf4-9d50-5a354c894620 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:28.845080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-208b29fb-dd9f-4cf4-9d50-5a354c894620 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:28.846033 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-208b29fb-dd9f-4cf4-9d50-5a354c894620 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:28.846675 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-208b29fb-dd9f-4cf4-9d50-5a354c894620 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:28.847365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-208b29fb-dd9f-4cf4-9d50-5a354c894620 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:28.873774 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-208b29fb-dd9f-4cf4-9d50-5a354c894620 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lazy-loading 'flavor' on Instance uuid 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:38:28.910918 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-de3d0a04-4ad4-4335-bdb2-09da0b7adc5f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:28.919937 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-de3d0a04-4ad4-4335-bdb2-09da0b7adc5f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.226583 Oct 27 09:38:28.920885 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 136/270] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:28 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:28.955469 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-208b29fb-dd9f-4cf4-9d50-5a354c894620 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed/action" status: 200 len: 32 microversion: 2.1 time: 0.142076 Oct 27 09:38:28.956272 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 135/271] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:38:28 2022] POST /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:38:28.965917 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3a812cb1-d38e-4dd5-9b54-0685474abf27 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:28.966528 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3a812cb1-d38e-4dd5-9b54-0685474abf27 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:28.972657 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a812cb1-d38e-4dd5-9b54-0685474abf27 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:28.973419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a812cb1-d38e-4dd5-9b54-0685474abf27 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:28.973775 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a812cb1-d38e-4dd5-9b54-0685474abf27 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:28.974593 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a812cb1-d38e-4dd5-9b54-0685474abf27 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:28.975564 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a812cb1-d38e-4dd5-9b54-0685474abf27 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:28.976720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3a812cb1-d38e-4dd5-9b54-0685474abf27 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:29.142957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3a812cb1-d38e-4dd5-9b54-0685474abf27 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:29.151962 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3a812cb1-d38e-4dd5-9b54-0685474abf27 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.190267 Oct 27 09:38:29.152571 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 137/272] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:28 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:29.787702 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-663e42f9-8a80-4a74-b8bb-6772336e522e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:29.788420 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-663e42f9-8a80-4a74-b8bb-6772336e522e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:29.802645 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-663e42f9-8a80-4a74-b8bb-6772336e522e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:29.802645 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-663e42f9-8a80-4a74-b8bb-6772336e522e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:29.803032 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-663e42f9-8a80-4a74-b8bb-6772336e522e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:29.803823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-663e42f9-8a80-4a74-b8bb-6772336e522e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:29.804276 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-663e42f9-8a80-4a74-b8bb-6772336e522e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:29.804723 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-663e42f9-8a80-4a74-b8bb-6772336e522e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:29.942523 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5baf94d9-bd41-4c66-94df-9c9fe3dd50c3 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:29.943165 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5baf94d9-bd41-4c66-94df-9c9fe3dd50c3 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:29.949678 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5baf94d9-bd41-4c66-94df-9c9fe3dd50c3 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:29.950497 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5baf94d9-bd41-4c66-94df-9c9fe3dd50c3 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:29.951011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5baf94d9-bd41-4c66-94df-9c9fe3dd50c3 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:29.951720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5baf94d9-bd41-4c66-94df-9c9fe3dd50c3 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:29.952172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5baf94d9-bd41-4c66-94df-9c9fe3dd50c3 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:29.956670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5baf94d9-bd41-4c66-94df-9c9fe3dd50c3 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:30.013324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-663e42f9-8a80-4a74-b8bb-6772336e522e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:30.033744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-663e42f9-8a80-4a74-b8bb-6772336e522e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1366 microversion: 2.1 time: 0.252911 Oct 27 09:38:30.034964 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 136/273] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:29 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:30.154558 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5baf94d9-bd41-4c66-94df-9c9fe3dd50c3 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:30.163286 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5baf94d9-bd41-4c66-94df-9c9fe3dd50c3 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.224427 Oct 27 09:38:30.166187 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 138/274] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:29 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:30.177148 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fafed924-bebd-416f-a1e0-4eb417c183b6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:30.178154 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fafed924-bebd-416f-a1e0-4eb417c183b6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:30.191080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fafed924-bebd-416f-a1e0-4eb417c183b6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:30.194321 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fafed924-bebd-416f-a1e0-4eb417c183b6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:30.196311 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fafed924-bebd-416f-a1e0-4eb417c183b6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:30.199622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fafed924-bebd-416f-a1e0-4eb417c183b6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:30.200201 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fafed924-bebd-416f-a1e0-4eb417c183b6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:30.200880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fafed924-bebd-416f-a1e0-4eb417c183b6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:30.450170 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fafed924-bebd-416f-a1e0-4eb417c183b6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:30.461456 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fafed924-bebd-416f-a1e0-4eb417c183b6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.289814 Oct 27 09:38:30.462283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 137/275] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:30 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:31.059352 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-baf73315-989e-4fd4-b2fa-8192b4462ab6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:31.060066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-baf73315-989e-4fd4-b2fa-8192b4462ab6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:31.066553 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-baf73315-989e-4fd4-b2fa-8192b4462ab6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:31.067036 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-baf73315-989e-4fd4-b2fa-8192b4462ab6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:31.067468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-baf73315-989e-4fd4-b2fa-8192b4462ab6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:31.068161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-baf73315-989e-4fd4-b2fa-8192b4462ab6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:31.069473 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-baf73315-989e-4fd4-b2fa-8192b4462ab6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:31.069473 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-baf73315-989e-4fd4-b2fa-8192b4462ab6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:31.187334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-aed69766-6a01-4506-9cff-6faae4f48e9b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:31.188641 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-aed69766-6a01-4506-9cff-6faae4f48e9b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:31.195684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aed69766-6a01-4506-9cff-6faae4f48e9b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:31.196325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aed69766-6a01-4506-9cff-6faae4f48e9b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:31.196790 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aed69766-6a01-4506-9cff-6faae4f48e9b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:31.197477 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aed69766-6a01-4506-9cff-6faae4f48e9b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:31.198324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aed69766-6a01-4506-9cff-6faae4f48e9b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:31.198747 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aed69766-6a01-4506-9cff-6faae4f48e9b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:31.215963 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-baf73315-989e-4fd4-b2fa-8192b4462ab6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:31.227449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-baf73315-989e-4fd4-b2fa-8192b4462ab6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1556 microversion: 2.1 time: 0.171850 Oct 27 09:38:31.228224 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 139/276] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:31 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:31.251366 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b648f46e-197b-4401-b42b-0aa867e70ec4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:31.251926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b648f46e-197b-4401-b42b-0aa867e70ec4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:31.258401 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b648f46e-197b-4401-b42b-0aa867e70ec4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:31.259307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b648f46e-197b-4401-b42b-0aa867e70ec4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:31.259740 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b648f46e-197b-4401-b42b-0aa867e70ec4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:31.261185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b648f46e-197b-4401-b42b-0aa867e70ec4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:31.261633 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b648f46e-197b-4401-b42b-0aa867e70ec4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:31.262052 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b648f46e-197b-4401-b42b-0aa867e70ec4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:31.372785 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b648f46e-197b-4401-b42b-0aa867e70ec4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125950 Oct 27 09:38:31.373465 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 140/277] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Oct 27 09:38:31 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:38:31.388316 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-aed69766-6a01-4506-9cff-6faae4f48e9b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:31.396137 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-aed69766-6a01-4506-9cff-6faae4f48e9b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.213057 Oct 27 09:38:31.396738 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 138/278] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:31 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:31.467096 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3f1aa382-34f5-46cd-90de-640add239ad2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:31.467605 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3f1aa382-34f5-46cd-90de-640add239ad2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:31.474094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3f1aa382-34f5-46cd-90de-640add239ad2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:31.474591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3f1aa382-34f5-46cd-90de-640add239ad2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:31.475027 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3f1aa382-34f5-46cd-90de-640add239ad2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:31.475971 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3f1aa382-34f5-46cd-90de-640add239ad2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:31.476423 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3f1aa382-34f5-46cd-90de-640add239ad2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:31.476873 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3f1aa382-34f5-46cd-90de-640add239ad2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:31.489121 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-13ba036b-b720-456a-8292-056270cdc7ec tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:31.489730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-13ba036b-b720-456a-8292-056270cdc7ec tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:31.502862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-13ba036b-b720-456a-8292-056270cdc7ec tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:31.503443 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-13ba036b-b720-456a-8292-056270cdc7ec tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:31.504021 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-13ba036b-b720-456a-8292-056270cdc7ec tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:31.504757 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-13ba036b-b720-456a-8292-056270cdc7ec tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:31.505210 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-13ba036b-b720-456a-8292-056270cdc7ec tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:31.505637 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-13ba036b-b720-456a-8292-056270cdc7ec tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:31.531821 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3f1aa382-34f5-46cd-90de-640add239ad2 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/ips" status: 200 len: 145 microversion: 2.1 time: 0.071361 Oct 27 09:38:31.532395 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 141/279] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Oct 27 09:38:31 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/ips => generated 145 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:38:31.685799 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-13ba036b-b720-456a-8292-056270cdc7ec tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:31.697276 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-13ba036b-b720-456a-8292-056270cdc7ec tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.211906 Oct 27 09:38:31.698702 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 139/280] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:31 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:32.421624 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-409630ad-d079-4771-af08-c2f2dc3b68a7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:32.422231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-409630ad-d079-4771-af08-c2f2dc3b68a7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:32.428149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-409630ad-d079-4771-af08-c2f2dc3b68a7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:32.428685 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-409630ad-d079-4771-af08-c2f2dc3b68a7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:32.429159 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-409630ad-d079-4771-af08-c2f2dc3b68a7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:32.429848 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-409630ad-d079-4771-af08-c2f2dc3b68a7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:32.430299 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-409630ad-d079-4771-af08-c2f2dc3b68a7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:32.430718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-409630ad-d079-4771-af08-c2f2dc3b68a7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:32.435004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:32.565201 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-409630ad-d079-4771-af08-c2f2dc3b68a7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:32.572977 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-409630ad-d079-4771-af08-c2f2dc3b68a7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.155053 Oct 27 09:38:32.573536 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 142/281] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:32 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:32.654309 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-5906912c-ae3a-4ade-b292-8ad521ca96b2 req-73988a4d-6465-4c9e-9caa-193e40995707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03530ba9-438a-41c2-8e0c-72e90cc316cc", "tag": "f81ca8dc-6051-4c47-b0e0-cafd4fc292d1"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:32.664077 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5906912c-ae3a-4ade-b292-8ad521ca96b2 req-73988a4d-6465-4c9e-9caa-193e40995707 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:32.664575 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5906912c-ae3a-4ade-b292-8ad521ca96b2 req-73988a4d-6465-4c9e-9caa-193e40995707 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:32.665018 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5906912c-ae3a-4ade-b292-8ad521ca96b2 req-73988a4d-6465-4c9e-9caa-193e40995707 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:32.677418 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-5906912c-ae3a-4ade-b292-8ad521ca96b2 req-73988a4d-6465-4c9e-9caa-193e40995707 service nova] Creating event network-changed:f81ca8dc-6051-4c47-b0e0-cafd4fc292d1 for instance 03530ba9-438a-41c2-8e0c-72e90cc316cc on hv-cinder-79797 Oct 27 09:38:32.682664 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-5906912c-ae3a-4ade-b292-8ad521ca96b2 req-73988a4d-6465-4c9e-9caa-193e40995707 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032727 Oct 27 09:38:32.683842 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 140/282] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:32.721399 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-573188bd-7a7b-4302-a049-d75459dcb737 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:32.722112 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-573188bd-7a7b-4302-a049-d75459dcb737 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:32.724015 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:32.729769 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-573188bd-7a7b-4302-a049-d75459dcb737 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:32.730359 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-573188bd-7a7b-4302-a049-d75459dcb737 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:32.730869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-573188bd-7a7b-4302-a049-d75459dcb737 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:32.731641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-573188bd-7a7b-4302-a049-d75459dcb737 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:32.732099 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-573188bd-7a7b-4302-a049-d75459dcb737 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:32.732612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-573188bd-7a7b-4302-a049-d75459dcb737 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:32.822111 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-bbd35983-9211-4060-8fbb-1b4a1be0d445 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:32.823220 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-bbd35983-9211-4060-8fbb-1b4a1be0d445 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:32.825666 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:32.832555 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bbd35983-9211-4060-8fbb-1b4a1be0d445 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:32.833053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bbd35983-9211-4060-8fbb-1b4a1be0d445 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:32.833486 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bbd35983-9211-4060-8fbb-1b4a1be0d445 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:32.834191 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bbd35983-9211-4060-8fbb-1b4a1be0d445 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:32.834652 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bbd35983-9211-4060-8fbb-1b4a1be0d445 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:32.835077 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bbd35983-9211-4060-8fbb-1b4a1be0d445 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:32.860027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-bbd35983-9211-4060-8fbb-1b4a1be0d445 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/ips" status: 200 len: 151 microversion: 2.20 time: 0.042012 Oct 27 09:38:32.867809 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 141/283] 10.222.0.70 () {60 vars in 1289 bytes} [Thu Oct 27 09:38:32 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:38:32.878571 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-573188bd-7a7b-4302-a049-d75459dcb737 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:32.886930 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-573188bd-7a7b-4302-a049-d75459dcb737 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.169412 Oct 27 09:38:32.888154 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 143/284] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:32 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:33.596924 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-cacf4543-a173-4735-abda-c7d77f40da56 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:33.597577 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-cacf4543-a173-4735-abda-c7d77f40da56 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:33.603459 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cacf4543-a173-4735-abda-c7d77f40da56 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:33.603946 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cacf4543-a173-4735-abda-c7d77f40da56 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:33.604380 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cacf4543-a173-4735-abda-c7d77f40da56 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:33.605094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cacf4543-a173-4735-abda-c7d77f40da56 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:33.605552 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cacf4543-a173-4735-abda-c7d77f40da56 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:33.605976 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cacf4543-a173-4735-abda-c7d77f40da56 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:33.737503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cacf4543-a173-4735-abda-c7d77f40da56 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:33.745213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-cacf4543-a173-4735-abda-c7d77f40da56 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.152208 Oct 27 09:38:33.745765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 142/285] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:33 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:33.912821 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-043555e9-d005-4ba2-8227-a988cdf99479 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:33.913433 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-043555e9-d005-4ba2-8227-a988cdf99479 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:33.919573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-043555e9-d005-4ba2-8227-a988cdf99479 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:33.920059 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-043555e9-d005-4ba2-8227-a988cdf99479 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:33.920492 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-043555e9-d005-4ba2-8227-a988cdf99479 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:33.921208 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-043555e9-d005-4ba2-8227-a988cdf99479 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:33.921659 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-043555e9-d005-4ba2-8227-a988cdf99479 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:33.922078 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-043555e9-d005-4ba2-8227-a988cdf99479 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:34.196850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-043555e9-d005-4ba2-8227-a988cdf99479 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:34.205363 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-043555e9-d005-4ba2-8227-a988cdf99479 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.296416 Oct 27 09:38:34.205927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 144/286] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:33 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:34.768220 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-18b63270-3b0f-4961-849a-589d9cd3c6dc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:34.768881 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-18b63270-3b0f-4961-849a-589d9cd3c6dc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:34.774866 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18b63270-3b0f-4961-849a-589d9cd3c6dc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:34.775348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18b63270-3b0f-4961-849a-589d9cd3c6dc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:34.776286 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18b63270-3b0f-4961-849a-589d9cd3c6dc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:34.777000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18b63270-3b0f-4961-849a-589d9cd3c6dc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:34.777453 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18b63270-3b0f-4961-849a-589d9cd3c6dc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:34.777872 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18b63270-3b0f-4961-849a-589d9cd3c6dc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:34.796199 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:34.908407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-18b63270-3b0f-4961-849a-589d9cd3c6dc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:34.916033 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-18b63270-3b0f-4961-849a-589d9cd3c6dc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.151849 Oct 27 09:38:34.917204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 143/287] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:34 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:35.233197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b83ff14d-7ee1-464f-ba78-41724f2dc267 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:35.236342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b83ff14d-7ee1-464f-ba78-41724f2dc267 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:35.242428 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b83ff14d-7ee1-464f-ba78-41724f2dc267 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:35.243011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b83ff14d-7ee1-464f-ba78-41724f2dc267 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:35.243515 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b83ff14d-7ee1-464f-ba78-41724f2dc267 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:35.244310 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b83ff14d-7ee1-464f-ba78-41724f2dc267 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:35.244854 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b83ff14d-7ee1-464f-ba78-41724f2dc267 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:35.245349 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b83ff14d-7ee1-464f-ba78-41724f2dc267 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:35.378828 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-e2e312bf-2770-43d2-8e59-0ef6b8af4e3b req-5b4ac1bd-4f44-419b-9f19-6f55d0ef450a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acba3b76-8223-4305-80d8-e739b12c6fcf", "name": "network-vif-plugged", "status": "completed", "tag": "265c29a2-64eb-4729-84e0-8504919ac033"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:35.389711 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-e2e312bf-2770-43d2-8e59-0ef6b8af4e3b req-5b4ac1bd-4f44-419b-9f19-6f55d0ef450a service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:35.390312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-e2e312bf-2770-43d2-8e59-0ef6b8af4e3b req-5b4ac1bd-4f44-419b-9f19-6f55d0ef450a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:35.390707 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-e2e312bf-2770-43d2-8e59-0ef6b8af4e3b req-5b4ac1bd-4f44-419b-9f19-6f55d0ef450a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:35.402459 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-e2e312bf-2770-43d2-8e59-0ef6b8af4e3b req-5b4ac1bd-4f44-419b-9f19-6f55d0ef450a service nova] Creating event network-vif-plugged:265c29a2-64eb-4729-84e0-8504919ac033 for instance acba3b76-8223-4305-80d8-e739b12c6fcf on hv-cinder-79797 Oct 27 09:38:35.407313 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-e2e312bf-2770-43d2-8e59-0ef6b8af4e3b req-5b4ac1bd-4f44-419b-9f19-6f55d0ef450a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032269 Oct 27 09:38:35.407905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 144/288] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:35.475787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b83ff14d-7ee1-464f-ba78-41724f2dc267 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:35.484397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b83ff14d-7ee1-464f-ba78-41724f2dc267 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.256211 Oct 27 09:38:35.485193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 145/289] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:35 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:35.940937 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-61abd80c-1c6d-46a7-9dd1-d605e61cf510 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:35.942248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-61abd80c-1c6d-46a7-9dd1-d605e61cf510 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:35.950105 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61abd80c-1c6d-46a7-9dd1-d605e61cf510 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:35.950652 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61abd80c-1c6d-46a7-9dd1-d605e61cf510 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:35.951096 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61abd80c-1c6d-46a7-9dd1-d605e61cf510 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:35.951815 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61abd80c-1c6d-46a7-9dd1-d605e61cf510 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:35.952298 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61abd80c-1c6d-46a7-9dd1-d605e61cf510 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:35.952756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61abd80c-1c6d-46a7-9dd1-d605e61cf510 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:36.154861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-61abd80c-1c6d-46a7-9dd1-d605e61cf510 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:36.162644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-61abd80c-1c6d-46a7-9dd1-d605e61cf510 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.227316 Oct 27 09:38:36.185859 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 145/290] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:35 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:36.507144 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-79e02333-9123-4a36-a840-9f9c1c294ea1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:36.507859 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-79e02333-9123-4a36-a840-9f9c1c294ea1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:36.514541 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79e02333-9123-4a36-a840-9f9c1c294ea1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:36.515029 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79e02333-9123-4a36-a840-9f9c1c294ea1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:36.515466 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79e02333-9123-4a36-a840-9f9c1c294ea1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:36.516185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79e02333-9123-4a36-a840-9f9c1c294ea1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:36.516670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79e02333-9123-4a36-a840-9f9c1c294ea1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:36.517126 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79e02333-9123-4a36-a840-9f9c1c294ea1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:36.646252 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-79e02333-9123-4a36-a840-9f9c1c294ea1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:36.655213 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-79e02333-9123-4a36-a840-9f9c1c294ea1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.151986 Oct 27 09:38:36.655782 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 146/291] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:36 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:37.062262 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ac5c2a39-39c8-40ee-8f07-eb497f8c0bc1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c6b0003-9ad7-45fb-b382-8bb76ad28d60"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:37.065697 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ac5c2a39-39c8-40ee-8f07-eb497f8c0bc1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:37.072712 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac5c2a39-39c8-40ee-8f07-eb497f8c0bc1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:37.073231 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac5c2a39-39c8-40ee-8f07-eb497f8c0bc1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:37.073705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac5c2a39-39c8-40ee-8f07-eb497f8c0bc1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:37.074537 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac5c2a39-39c8-40ee-8f07-eb497f8c0bc1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:37.075027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac5c2a39-39c8-40ee-8f07-eb497f8c0bc1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:37.075568 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac5c2a39-39c8-40ee-8f07-eb497f8c0bc1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:37.189761 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-744df871-4dba-4660-9833-53e2f01b75b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:37.190379 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-744df871-4dba-4660-9833-53e2f01b75b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:37.192232 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=4 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:37.197701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744df871-4dba-4660-9833-53e2f01b75b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:37.198508 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744df871-4dba-4660-9833-53e2f01b75b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:37.199062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744df871-4dba-4660-9833-53e2f01b75b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:37.199864 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744df871-4dba-4660-9833-53e2f01b75b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:37.200325 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744df871-4dba-4660-9833-53e2f01b75b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:37.200786 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744df871-4dba-4660-9833-53e2f01b75b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:37.336207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-744df871-4dba-4660-9833-53e2f01b75b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:37.344451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-744df871-4dba-4660-9833-53e2f01b75b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1319 microversion: 2.1 time: 0.158602 Oct 27 09:38:37.345041 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 147/292] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:37 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:37.679084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-80133647-de44-4fa7-b08d-9ef899c4cd81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:37.679794 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-80133647-de44-4fa7-b08d-9ef899c4cd81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:37.686464 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80133647-de44-4fa7-b08d-9ef899c4cd81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:37.686962 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80133647-de44-4fa7-b08d-9ef899c4cd81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:37.687408 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80133647-de44-4fa7-b08d-9ef899c4cd81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:37.688119 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80133647-de44-4fa7-b08d-9ef899c4cd81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:37.688599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80133647-de44-4fa7-b08d-9ef899c4cd81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:37.689025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80133647-de44-4fa7-b08d-9ef899c4cd81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:37.885003 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-80133647-de44-4fa7-b08d-9ef899c4cd81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:37.895401 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-80133647-de44-4fa7-b08d-9ef899c4cd81 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.220161 Oct 27 09:38:37.895984 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 148/293] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:37 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:37.901570 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-74afcc3b-032f-4175-91c7-dced4eea8c8e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:37.902281 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-74afcc3b-032f-4175-91c7-dced4eea8c8e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:37.909428 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-74afcc3b-032f-4175-91c7-dced4eea8c8e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:37.910133 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-74afcc3b-032f-4175-91c7-dced4eea8c8e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:37.910713 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-74afcc3b-032f-4175-91c7-dced4eea8c8e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:37.911838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-74afcc3b-032f-4175-91c7-dced4eea8c8e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:37.912460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-74afcc3b-032f-4175-91c7-dced4eea8c8e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:37.912920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-74afcc3b-032f-4175-91c7-dced4eea8c8e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:37.945118 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-74afcc3b-032f-4175-91c7-dced4eea8c8e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lazy-loading 'flavor' on Instance uuid 8ac6a130-38c4-4843-b9a8-118d25c11c18 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:38:37.997442 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ac5c2a39-39c8-40ee-8f07-eb497f8c0bc1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.938624 Oct 27 09:38:37.998786 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 146/294] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:38:37 2022] POST /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:38:38.220369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-74afcc3b-032f-4175-91c7-dced4eea8c8e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "POST /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/action" status: 202 len: 0 microversion: 2.20 time: 0.322901 Oct 27 09:38:38.221020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 149/295] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Oct 27 09:38:37 2022] POST /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:38:38.230200 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:38.231733 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:38.238312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:38.238808 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:38.239242 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:38.239948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:38.240406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:38.240906 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:38.368244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-72e3fc49-8128-4086-91ff-623f5335b85f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:38.368964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-72e3fc49-8128-4086-91ff-623f5335b85f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:38.375714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-72e3fc49-8128-4086-91ff-623f5335b85f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:38.376209 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-72e3fc49-8128-4086-91ff-623f5335b85f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:38.376670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-72e3fc49-8128-4086-91ff-623f5335b85f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:38.377370 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-72e3fc49-8128-4086-91ff-623f5335b85f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:38.377826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-72e3fc49-8128-4086-91ff-623f5335b85f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:38.378245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-72e3fc49-8128-4086-91ff-623f5335b85f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:38.378906 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:38.386969 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:38.388587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:38.389801 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-bb92c945-12d7-425d-8eb6-e806147e04ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.164284 Oct 27 09:38:38.390377 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 147/296] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:38 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:38:38.515405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-72e3fc49-8128-4086-91ff-623f5335b85f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:38.523744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-72e3fc49-8128-4086-91ff-623f5335b85f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1507 microversion: 2.1 time: 0.159929 Oct 27 09:38:38.528572 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 150/297] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:38 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:38.923156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b2a9ba0b-0ac9-48e2-9f74-c3a8a9dc79b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:38.923643 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b2a9ba0b-0ac9-48e2-9f74-c3a8a9dc79b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:38.939300 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b2a9ba0b-0ac9-48e2-9f74-c3a8a9dc79b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:38.939858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b2a9ba0b-0ac9-48e2-9f74-c3a8a9dc79b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:38.940257 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b2a9ba0b-0ac9-48e2-9f74-c3a8a9dc79b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:38.941087 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b2a9ba0b-0ac9-48e2-9f74-c3a8a9dc79b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:38.943497 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b2a9ba0b-0ac9-48e2-9f74-c3a8a9dc79b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:38.944118 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b2a9ba0b-0ac9-48e2-9f74-c3a8a9dc79b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:39.116264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b2a9ba0b-0ac9-48e2-9f74-c3a8a9dc79b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:39.124439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b2a9ba0b-0ac9-48e2-9f74-c3a8a9dc79b2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.206420 Oct 27 09:38:39.125038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 148/298] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:38 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:39.415055 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:39.415665 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:39.421639 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:39.422122 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:39.422558 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:39.423245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:39.423701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:39.424123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:39.561573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:39.569737 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:39.571184 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:39.572341 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e43cf717-ecba-498e-a754-7fab112b39c4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.161202 Oct 27 09:38:39.572928 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 151/299] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:39 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:40.148549 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-bb8c0787-3b23-4f03-8ee2-c6e3ae90ff4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:40.149172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-bb8c0787-3b23-4f03-8ee2-c6e3ae90ff4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:40.158764 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb8c0787-3b23-4f03-8ee2-c6e3ae90ff4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:40.161096 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb8c0787-3b23-4f03-8ee2-c6e3ae90ff4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:40.161525 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb8c0787-3b23-4f03-8ee2-c6e3ae90ff4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:40.162244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb8c0787-3b23-4f03-8ee2-c6e3ae90ff4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:40.162703 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb8c0787-3b23-4f03-8ee2-c6e3ae90ff4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:40.163141 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb8c0787-3b23-4f03-8ee2-c6e3ae90ff4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:40.301714 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bb8c0787-3b23-4f03-8ee2-c6e3ae90ff4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:40.309815 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-bb8c0787-3b23-4f03-8ee2-c6e3ae90ff4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.165190 Oct 27 09:38:40.310395 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 149/300] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:40 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:40.596952 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:40.597558 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:40.603518 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:40.603994 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:40.604419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:40.605117 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:40.606198 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:40.606616 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:40.739250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:40.747829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:40.749316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:40.750467 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e888b57e-7f97-43e6-b89c-999d0b6c73f8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.157358 Oct 27 09:38:40.751024 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 152/301] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:40 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:41.333146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-99f1757c-0d06-404f-bf06-843df11b28d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:41.333842 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-99f1757c-0d06-404f-bf06-843df11b28d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:41.340966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99f1757c-0d06-404f-bf06-843df11b28d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:41.341645 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99f1757c-0d06-404f-bf06-843df11b28d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:41.342075 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99f1757c-0d06-404f-bf06-843df11b28d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:41.342796 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99f1757c-0d06-404f-bf06-843df11b28d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:41.343209 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99f1757c-0d06-404f-bf06-843df11b28d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:41.343649 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99f1757c-0d06-404f-bf06-843df11b28d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:41.484829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-99f1757c-0d06-404f-bf06-843df11b28d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:41.492559 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-99f1757c-0d06-404f-bf06-843df11b28d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.163470 Oct 27 09:38:41.493131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 150/302] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:41 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:41.777894 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:41.778618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:41.784823 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:41.785312 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:41.785737 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:41.786424 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:41.786873 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:41.787304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:41.932682 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:41.947803 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:41.949954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:41.951380 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b768efab-7afc-4bff-82a4-2cd2ebc73e20 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.178125 Oct 27 09:38:41.952015 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 153/303] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:41 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:42.519182 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d25d1ce8-401a-42e9-97d2-725ee5bc5ba6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:42.520337 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d25d1ce8-401a-42e9-97d2-725ee5bc5ba6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:42.531288 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d25d1ce8-401a-42e9-97d2-725ee5bc5ba6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:42.532100 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d25d1ce8-401a-42e9-97d2-725ee5bc5ba6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:42.532862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d25d1ce8-401a-42e9-97d2-725ee5bc5ba6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:42.533848 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d25d1ce8-401a-42e9-97d2-725ee5bc5ba6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:42.534668 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d25d1ce8-401a-42e9-97d2-725ee5bc5ba6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:42.535450 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d25d1ce8-401a-42e9-97d2-725ee5bc5ba6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:42.686392 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d25d1ce8-401a-42e9-97d2-725ee5bc5ba6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:42.694098 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d25d1ce8-401a-42e9-97d2-725ee5bc5ba6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.181550 Oct 27 09:38:42.694656 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 151/304] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:42 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:42.977565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:42.978155 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:42.985488 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:42.986079 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:42.986513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:42.987229 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:42.987859 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:42.988274 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:43.223613 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:43.232256 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:43.233739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:43.234887 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6d2a855d-f6da-4fb7-b9a4-e9e2b57ac00c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.261272 Oct 27 09:38:43.235450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 154/305] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:42 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:43.717859 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-013bd618-988f-492e-b749-2fb5cbda2c0f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:43.718675 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-013bd618-988f-492e-b749-2fb5cbda2c0f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:43.725627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-013bd618-988f-492e-b749-2fb5cbda2c0f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:43.726358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-013bd618-988f-492e-b749-2fb5cbda2c0f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:43.727057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-013bd618-988f-492e-b749-2fb5cbda2c0f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:43.728042 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-013bd618-988f-492e-b749-2fb5cbda2c0f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:43.728884 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-013bd618-988f-492e-b749-2fb5cbda2c0f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:43.729560 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-013bd618-988f-492e-b749-2fb5cbda2c0f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:44.200455 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-013bd618-988f-492e-b749-2fb5cbda2c0f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:44.208854 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-013bd618-988f-492e-b749-2fb5cbda2c0f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.495383 Oct 27 09:38:44.209520 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 152/306] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:43 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:44.260348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:44.261096 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:44.270128 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:44.272718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:44.273293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:44.274940 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:44.276093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:44.276817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:44.546000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:44.559863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:44.570064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:44.571454 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-860db084-e995-4cb2-9248-872ed04c2f71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.315515 Oct 27 09:38:44.573575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 155/307] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:44 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:45.237961 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-61ee9335-a5a1-40b9-9e14-16eba0e74952 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:45.238730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-61ee9335-a5a1-40b9-9e14-16eba0e74952 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:45.249937 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61ee9335-a5a1-40b9-9e14-16eba0e74952 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:45.250584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61ee9335-a5a1-40b9-9e14-16eba0e74952 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:45.251168 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61ee9335-a5a1-40b9-9e14-16eba0e74952 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:45.252152 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61ee9335-a5a1-40b9-9e14-16eba0e74952 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:45.252862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61ee9335-a5a1-40b9-9e14-16eba0e74952 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:45.253530 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61ee9335-a5a1-40b9-9e14-16eba0e74952 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:45.484928 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-61ee9335-a5a1-40b9-9e14-16eba0e74952 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:45.501485 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-61ee9335-a5a1-40b9-9e14-16eba0e74952 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.269868 Oct 27 09:38:45.502070 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 153/308] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:45 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:45.608442 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:45.609414 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:45.617309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:45.620624 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:45.621242 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:45.622605 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:45.623178 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:45.623714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:45.794522 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4c89830d-70c4-40ba-9d64-63b756e45195 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:45.814386 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c89830d-70c4-40ba-9d64-63b756e45195 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:45.816899 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c89830d-70c4-40ba-9d64-63b756e45195 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:45.817580 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c89830d-70c4-40ba-9d64-63b756e45195 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:45.920416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4c89830d-70c4-40ba-9d64-63b756e45195 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Going to try to stop instance {{(pid=125362) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:38:45.971644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4c89830d-70c4-40ba-9d64-63b756e45195 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/action" status: 202 len: 0 microversion: 2.1 time: 0.181401 Oct 27 09:38:45.972871 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 154/309] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:38:45 2022] POST /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:38:45.981814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9a72db30-1aec-4088-a613-479ea7cc8fe9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:45.982923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9a72db30-1aec-4088-a613-479ea7cc8fe9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:45.987133 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:45.989874 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a72db30-1aec-4088-a613-479ea7cc8fe9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:45.990530 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a72db30-1aec-4088-a613-479ea7cc8fe9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:45.991167 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a72db30-1aec-4088-a613-479ea7cc8fe9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:45.992074 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a72db30-1aec-4088-a613-479ea7cc8fe9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:45.992718 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a72db30-1aec-4088-a613-479ea7cc8fe9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:45.993321 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a72db30-1aec-4088-a613-479ea7cc8fe9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:45.996990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:46.013070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:46.017592 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:46.027835 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-925e85f5-f512-42ce-852f-1f67264a9514 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.425376 Oct 27 09:38:46.029088 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 156/310] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:45 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:46.223130 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9a72db30-1aec-4088-a613-479ea7cc8fe9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:46.233777 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9a72db30-1aec-4088-a613-479ea7cc8fe9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.257009 Oct 27 09:38:46.234632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 155/311] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:45 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:46.531744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-caea6a38-4cf6-4a99-a0da-5d59c585074e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:46.532825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-caea6a38-4cf6-4a99-a0da-5d59c585074e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:46.540788 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-caea6a38-4cf6-4a99-a0da-5d59c585074e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:46.541578 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-caea6a38-4cf6-4a99-a0da-5d59c585074e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:46.542108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-caea6a38-4cf6-4a99-a0da-5d59c585074e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:46.542859 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-caea6a38-4cf6-4a99-a0da-5d59c585074e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:46.543418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-caea6a38-4cf6-4a99-a0da-5d59c585074e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:46.543791 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-caea6a38-4cf6-4a99-a0da-5d59c585074e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:46.819508 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-caea6a38-4cf6-4a99-a0da-5d59c585074e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:46.842155 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-caea6a38-4cf6-4a99-a0da-5d59c585074e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.316211 Oct 27 09:38:46.843193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 157/312] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:46 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:47.055728 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:47.057480 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:47.064003 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:47.064671 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:47.065173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:47.065938 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:47.066480 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:47.067092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:47.258396 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-edfc3567-a96c-4d00-8099-46a90e6e317e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:47.259772 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-edfc3567-a96c-4d00-8099-46a90e6e317e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:47.267290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edfc3567-a96c-4d00-8099-46a90e6e317e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:47.268094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edfc3567-a96c-4d00-8099-46a90e6e317e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:47.268746 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edfc3567-a96c-4d00-8099-46a90e6e317e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:47.269644 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edfc3567-a96c-4d00-8099-46a90e6e317e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:47.270287 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edfc3567-a96c-4d00-8099-46a90e6e317e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:47.270918 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edfc3567-a96c-4d00-8099-46a90e6e317e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:47.336389 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:47.346955 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:47.348391 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:47.349586 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-209e0060-890d-4352-9cc9-0cc2bda21232 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.298154 Oct 27 09:38:47.350141 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 156/313] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:47 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:47.491481 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-edfc3567-a96c-4d00-8099-46a90e6e317e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:47.505290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-edfc3567-a96c-4d00-8099-46a90e6e317e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.250690 Oct 27 09:38:47.509845 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 158/314] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:47 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:47.866986 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-bd0283ec-fd1b-410a-bcb4-b00a3dacc2c9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:47.867729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-bd0283ec-fd1b-410a-bcb4-b00a3dacc2c9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:47.875087 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bd0283ec-fd1b-410a-bcb4-b00a3dacc2c9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:47.875774 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bd0283ec-fd1b-410a-bcb4-b00a3dacc2c9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:47.876370 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bd0283ec-fd1b-410a-bcb4-b00a3dacc2c9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:47.877266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bd0283ec-fd1b-410a-bcb4-b00a3dacc2c9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:47.877794 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bd0283ec-fd1b-410a-bcb4-b00a3dacc2c9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:47.878281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bd0283ec-fd1b-410a-bcb4-b00a3dacc2c9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:48.102185 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bd0283ec-fd1b-410a-bcb4-b00a3dacc2c9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:48.113650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-bd0283ec-fd1b-410a-bcb4-b00a3dacc2c9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.252080 Oct 27 09:38:48.114238 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 157/315] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:47 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:48.375876 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:48.376486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:48.382626 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:48.383108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:48.383550 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:48.384248 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:48.384729 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:48.385149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:48.520561 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:48.530250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:48.532826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:48.534473 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cf351314-b997-40c0-a7b0-f290fefc717d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.162503 Oct 27 09:38:48.535533 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 159/316] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:48 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:48.536134 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2d6af3f6-38bc-4556-894f-7fcf7d622772 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:48.536854 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2d6af3f6-38bc-4556-894f-7fcf7d622772 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:48.548586 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d6af3f6-38bc-4556-894f-7fcf7d622772 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:48.549651 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d6af3f6-38bc-4556-894f-7fcf7d622772 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:48.550636 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d6af3f6-38bc-4556-894f-7fcf7d622772 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:48.552882 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d6af3f6-38bc-4556-894f-7fcf7d622772 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:48.553516 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d6af3f6-38bc-4556-894f-7fcf7d622772 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:48.554108 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d6af3f6-38bc-4556-894f-7fcf7d622772 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:48.582958 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:48.716051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2d6af3f6-38bc-4556-894f-7fcf7d622772 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:48.725689 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2d6af3f6-38bc-4556-894f-7fcf7d622772 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.197190 Oct 27 09:38:48.726705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 158/317] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:48 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:49.139667 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ca02c3f1-5ff1-4215-8728-7ddedb03d088 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:49.140387 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ca02c3f1-5ff1-4215-8728-7ddedb03d088 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:49.149313 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca02c3f1-5ff1-4215-8728-7ddedb03d088 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:49.150267 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca02c3f1-5ff1-4215-8728-7ddedb03d088 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:49.151071 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca02c3f1-5ff1-4215-8728-7ddedb03d088 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:49.152624 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca02c3f1-5ff1-4215-8728-7ddedb03d088 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:49.153358 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca02c3f1-5ff1-4215-8728-7ddedb03d088 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:49.154037 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca02c3f1-5ff1-4215-8728-7ddedb03d088 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:49.313573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ca02c3f1-5ff1-4215-8728-7ddedb03d088 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:49.329973 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ca02c3f1-5ff1-4215-8728-7ddedb03d088 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.194423 Oct 27 09:38:49.331884 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 160/318] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:49 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:49.571885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:49.573167 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:49.582697 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:49.583620 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:49.584560 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:49.599534 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:49.600436 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:49.601120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:49.755468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-52c69f49-2c3f-42ef-acfb-bf421fcc4ab0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:49.756191 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-52c69f49-2c3f-42ef-acfb-bf421fcc4ab0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:49.767529 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52c69f49-2c3f-42ef-acfb-bf421fcc4ab0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:49.770645 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52c69f49-2c3f-42ef-acfb-bf421fcc4ab0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:49.772756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52c69f49-2c3f-42ef-acfb-bf421fcc4ab0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:49.774536 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52c69f49-2c3f-42ef-acfb-bf421fcc4ab0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:49.776389 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52c69f49-2c3f-42ef-acfb-bf421fcc4ab0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:49.777510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52c69f49-2c3f-42ef-acfb-bf421fcc4ab0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:49.841166 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:49.881239 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:49.888308 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:49.892796 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-363c5ac0-77c3-4537-a0dd-62accc279c3d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.329672 Oct 27 09:38:49.894854 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 159/319] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:49 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:50.065143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-52c69f49-2c3f-42ef-acfb-bf421fcc4ab0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:50.076056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-52c69f49-2c3f-42ef-acfb-bf421fcc4ab0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.329389 Oct 27 09:38:50.094066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 161/320] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:49 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:50.360709 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0e1a45c6-b882-4bcc-a975-ed29c9c8f183 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:50.362094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0e1a45c6-b882-4bcc-a975-ed29c9c8f183 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:50.373682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0e1a45c6-b882-4bcc-a975-ed29c9c8f183 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:50.374531 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0e1a45c6-b882-4bcc-a975-ed29c9c8f183 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:50.375042 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0e1a45c6-b882-4bcc-a975-ed29c9c8f183 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:50.375852 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0e1a45c6-b882-4bcc-a975-ed29c9c8f183 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:50.376382 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0e1a45c6-b882-4bcc-a975-ed29c9c8f183 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:50.376913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0e1a45c6-b882-4bcc-a975-ed29c9c8f183 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:50.531119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0e1a45c6-b882-4bcc-a975-ed29c9c8f183 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:50.539447 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0e1a45c6-b882-4bcc-a975-ed29c9c8f183 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.185338 Oct 27 09:38:50.540464 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 160/321] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:50 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:50.927465 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:50.930253 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:50.938180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:50.938879 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:50.939487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:50.940348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:50.940987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:50.941581 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:51.106682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b396c0c2-680d-4d9d-bb51-499325ed0545 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:51.107299 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b396c0c2-680d-4d9d-bb51-499325ed0545 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:51.116002 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b396c0c2-680d-4d9d-bb51-499325ed0545 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:51.116718 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b396c0c2-680d-4d9d-bb51-499325ed0545 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:51.120260 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b396c0c2-680d-4d9d-bb51-499325ed0545 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:51.121810 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b396c0c2-680d-4d9d-bb51-499325ed0545 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:51.122701 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b396c0c2-680d-4d9d-bb51-499325ed0545 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:51.125143 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b396c0c2-680d-4d9d-bb51-499325ed0545 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:51.617776 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:51.634977 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b396c0c2-680d-4d9d-bb51-499325ed0545 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:51.636756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:51.638767 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:51.640709 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4846e626-5499-42b3-a72d-4ad98d0f650f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.718091 Oct 27 09:38:51.647731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 162/322] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:50 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:38:51.648739 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b396c0c2-680d-4d9d-bb51-499325ed0545 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.545183 Oct 27 09:38:51.649492 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 161/323] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:51 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:51.680265 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-87f119f9-1d1f-4a56-afcd-b0061ac0ecf3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:51.680907 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-87f119f9-1d1f-4a56-afcd-b0061ac0ecf3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:51.701407 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-87f119f9-1d1f-4a56-afcd-b0061ac0ecf3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:51.701906 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-87f119f9-1d1f-4a56-afcd-b0061ac0ecf3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:51.702595 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-87f119f9-1d1f-4a56-afcd-b0061ac0ecf3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:51.704401 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-87f119f9-1d1f-4a56-afcd-b0061ac0ecf3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:51.704872 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-87f119f9-1d1f-4a56-afcd-b0061ac0ecf3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:51.705513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-87f119f9-1d1f-4a56-afcd-b0061ac0ecf3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:52.034044 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-87f119f9-1d1f-4a56-afcd-b0061ac0ecf3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:52.043907 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-87f119f9-1d1f-4a56-afcd-b0061ac0ecf3 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.394751 Oct 27 09:38:52.044507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 163/324] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:51 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:52.684084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e350d4f3-871f-4e96-b4a9-3865a6e08053 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:52.689749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:52.690599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:52.691503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e350d4f3-871f-4e96-b4a9-3865a6e08053 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:52.705284 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e350d4f3-871f-4e96-b4a9-3865a6e08053 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:52.705624 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:52.706278 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:52.706421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e350d4f3-871f-4e96-b4a9-3865a6e08053 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:52.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:52.707306 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e350d4f3-871f-4e96-b4a9-3865a6e08053 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:52.707964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:52.708334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e350d4f3-871f-4e96-b4a9-3865a6e08053 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:52.708687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:52.709232 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e350d4f3-871f-4e96-b4a9-3865a6e08053 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:52.709364 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:52.710018 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e350d4f3-871f-4e96-b4a9-3865a6e08053 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:53.090903 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:53.093372 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e350d4f3-871f-4e96-b4a9-3865a6e08053 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:53.101788 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:53.102845 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e350d4f3-871f-4e96-b4a9-3865a6e08053 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.422547 Oct 27 09:38:53.103587 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:53.105137 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1bed90ad-2592-4d76-8b63-3ab33f3f6e9e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.419269 Oct 27 09:38:53.123114 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 162/325] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:52 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:53.128999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 164/326] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:52 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:53.129131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-27d36eee-abc2-429d-a9dd-c8bfc33cf1f4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:53.129686 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-27d36eee-abc2-429d-a9dd-c8bfc33cf1f4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:53.136948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d36eee-abc2-429d-a9dd-c8bfc33cf1f4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:53.137639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d36eee-abc2-429d-a9dd-c8bfc33cf1f4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:53.138079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d36eee-abc2-429d-a9dd-c8bfc33cf1f4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:53.138788 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d36eee-abc2-429d-a9dd-c8bfc33cf1f4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:53.139333 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d36eee-abc2-429d-a9dd-c8bfc33cf1f4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:53.139765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d36eee-abc2-429d-a9dd-c8bfc33cf1f4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:53.360105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1345299428", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1429495316", "security_groups": [{"name": "tempest-secgroup-smoke-132908395"}], "networks": [{"uuid": "909c1cb1-0f08-4b83-89ee-b2f8ffdd84dd"}], "block_device_mapping_v2": [{"uuid": "6bbe70bb-fb1e-4bb0-9213-8d7f08ef76e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:53.412366 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-27d36eee-abc2-429d-a9dd-c8bfc33cf1f4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:53.420622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-27d36eee-abc2-429d-a9dd-c8bfc33cf1f4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.295956 Oct 27 09:38:53.421189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 163/327] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:53 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:53.599213 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.network.neutron [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] validate_networks() for [('909c1cb1-0f08-4b83-89ee-b2f8ffdd84dd', None, None, None, None, None)] {{(pid=125361) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:38:54.134938 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-93d4d476-f314-4643-86ce-1805d0ac319c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:54.136939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-93d4d476-f314-4643-86ce-1805d0ac319c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:54.145836 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93d4d476-f314-4643-86ce-1805d0ac319c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.146595 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93d4d476-f314-4643-86ce-1805d0ac319c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.147222 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93d4d476-f314-4643-86ce-1805d0ac319c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.152792 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93d4d476-f314-4643-86ce-1805d0ac319c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.153475 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93d4d476-f314-4643-86ce-1805d0ac319c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.154104 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93d4d476-f314-4643-86ce-1805d0ac319c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.202860 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Flavor limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:38:54.204667 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Image limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:38:54.205677 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Flavor pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:38:54.206258 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Image pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:38:54.206990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:38:54.220477 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.221502 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.221946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.224714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.224714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.224714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.245847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Getting quotas for project f7b8fb656ee34fae8d20679c0e0f7ff9. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:38:54.250671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Getting quotas for user 0968b48cb99d4168b36a2602bd87f788 and project f7b8fb656ee34fae8d20679c0e0f7ff9. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:38:54.323093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Going to run 1 instances... {{(pid=125361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:38:54.325266 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6bbe70bb-fb1e-4bb0-9213-8d7f08ef76e4',volume_size=None,volume_type=None)] {{(pid=125361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:38:54.362547 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-93d4d476-f314-4643-86ce-1805d0ac319c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:54.375136 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-93d4d476-f314-4643-86ce-1805d0ac319c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.251366 Oct 27 09:38:54.375730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 164/328] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:54 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:54.384354 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:54.385159 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:54.391466 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.392178 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.392901 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.393772 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.394382 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.394950 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.553768 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8a5924da-d086-4834-b524-3c6c9a61cf99 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.203664 Oct 27 09:38:54.564396 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 165/329] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:38:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:38:54.579540 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ab321cbd-ffcf-46ec-944d-55fdabc8572b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:54.580157 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ab321cbd-ffcf-46ec-944d-55fdabc8572b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:54.588038 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab321cbd-ffcf-46ec-944d-55fdabc8572b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.588616 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab321cbd-ffcf-46ec-944d-55fdabc8572b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.589284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab321cbd-ffcf-46ec-944d-55fdabc8572b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.589995 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab321cbd-ffcf-46ec-944d-55fdabc8572b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.590443 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab321cbd-ffcf-46ec-944d-55fdabc8572b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.590862 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab321cbd-ffcf-46ec-944d-55fdabc8572b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.624219 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:54.633943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:54.636390 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:54.637825 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8ec3b38f-05eb-4147-b329-b6b312d0f467 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.257171 Oct 27 09:38:54.639419 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 165/330] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:54 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:54.644062 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f0038399-0473-43bd-9312-b40c143ae6b2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:54.644690 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f0038399-0473-43bd-9312-b40c143ae6b2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:54.758496 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f0038399-0473-43bd-9312-b40c143ae6b2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:54.769246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f0038399-0473-43bd-9312-b40c143ae6b2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1089 microversion: 2.1 time: 0.128647 Oct 27 09:38:54.771051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 166/331] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:54 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1089 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:54.833299 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ab321cbd-ffcf-46ec-944d-55fdabc8572b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:54.843669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ab321cbd-ffcf-46ec-944d-55fdabc8572b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1502 microversion: 2.1 time: 0.277998 Oct 27 09:38:54.844236 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 166/332] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:54 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:54.868124 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94a4ba2f-3721-475f-ab0d-d885704f5696"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:54.871288 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:54.882744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.883508 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.884596 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.885165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.885823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.886578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.926656 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] HTTP exception thrown: Cannot 'attach_volume' instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed while it is in vm_state rescued Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Request method failure captured: Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: POST /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed/os-volume_attachments HTTP/1.1 Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 74 Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEs5-tbzfNHaXrPO8RXRj9dewnCV2HOUd33_QWfCuKyBAx1Ix27FgqyKSHqu3c5HxuyE46MIa6u9OKbQgr2_gH2DdthtJSgHCsIx2TZb8X_KnoKljFtMa40Qmv-Uellj9bNNfFAaBQ2vKscoeJD-eIA3KY14nB7Y7QCgN9f6RkwKtc Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df306d37ff634f7eaad80fc3bc65b653 Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:38:54.928839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df306d37ff634f7eaad80fc3bc65b653 Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-ServerRescueNegativeTestJSON-1374072368-project Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 20c65ed67cd8403489949c4dea572d01 Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1374072368-project Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {"volumeAttachment": {"volumeId": "94a4ba2f-3721-475f-ab0d-d885704f5696"}} Oct 27 09:38:54.930457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Cannot 'attach_volume' instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed while it is in vm_state rescued Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'server_id': '4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed', 'body': {'volumeAttachment': {'volumeId': '94a4ba2f-3721-475f-ab0d-d885704f5696'}}} Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:38:54.931245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed while it is in vm_state rescued Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:38:54.932692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:38:54.934448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:38:54.934448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:38:54.934448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed while it is in vm_state rescued Oct 27 09:38:54.934448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:38:54.934448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Returning 409 to user: Cannot 'attach_volume' instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed while it is in vm_state rescued {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:38:54.934448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3fdff8e1-6ada-4e31-808a-91c0c6fe3302 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.066664 Oct 27 09:38:54.934448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 167/333] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:38:54 2022] POST /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed/os-volume_attachments => generated 152 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 09:38:54.941549 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-269208ff-6a71-4872-84e7-d13da655eab4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:38:54.942188 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-269208ff-6a71-4872-84e7-d13da655eab4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:54.950732 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-269208ff-6a71-4872-84e7-d13da655eab4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.952718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-269208ff-6a71-4872-84e7-d13da655eab4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.953499 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-269208ff-6a71-4872-84e7-d13da655eab4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:54.954779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-269208ff-6a71-4872-84e7-d13da655eab4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:54.955602 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-269208ff-6a71-4872-84e7-d13da655eab4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:54.956466 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-269208ff-6a71-4872-84e7-d13da655eab4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:55.054878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-269208ff-6a71-4872-84e7-d13da655eab4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed/action" status: 202 len: 0 microversion: 2.1 time: 0.117648 Oct 27 09:38:55.060779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 167/334] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:38:54 2022] POST /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:38:55.064980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0a2764c3-995b-4858-b272-b8f897b99cba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:55.065601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0a2764c3-995b-4858-b272-b8f897b99cba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:55.075460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a2764c3-995b-4858-b272-b8f897b99cba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:55.076174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a2764c3-995b-4858-b272-b8f897b99cba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:55.076799 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a2764c3-995b-4858-b272-b8f897b99cba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:55.077683 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a2764c3-995b-4858-b272-b8f897b99cba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:55.078353 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a2764c3-995b-4858-b272-b8f897b99cba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:55.079033 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0a2764c3-995b-4858-b272-b8f897b99cba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:55.411455 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0a2764c3-995b-4858-b272-b8f897b99cba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:55.412491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4a2033d1-d3aa-4f5f-9fee-cd1d7dd7b106 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:55.413258 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4a2033d1-d3aa-4f5f-9fee-cd1d7dd7b106 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:55.419892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0a2764c3-995b-4858-b272-b8f897b99cba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1510 microversion: 2.1 time: 0.358614 Oct 27 09:38:55.421176 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 168/335] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:55 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1510 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:55.433492 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a2033d1-d3aa-4f5f-9fee-cd1d7dd7b106 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:55.434433 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a2033d1-d3aa-4f5f-9fee-cd1d7dd7b106 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:55.436469 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a2033d1-d3aa-4f5f-9fee-cd1d7dd7b106 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:55.439519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a2033d1-d3aa-4f5f-9fee-cd1d7dd7b106 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:55.440161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a2033d1-d3aa-4f5f-9fee-cd1d7dd7b106 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:55.441096 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a2033d1-d3aa-4f5f-9fee-cd1d7dd7b106 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:55.665210 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:55.665750 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:55.677969 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:55.679583 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:55.680076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:55.681273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:55.682173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:55.682632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:55.704479 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4a2033d1-d3aa-4f5f-9fee-cd1d7dd7b106 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:55.718630 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4a2033d1-d3aa-4f5f-9fee-cd1d7dd7b106 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.307925 Oct 27 09:38:55.720915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 168/336] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:55 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:55.793491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-43fb8904-eb72-42e7-8570-0e3e78634588 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:55.794637 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-43fb8904-eb72-42e7-8570-0e3e78634588 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:55.809033 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43fb8904-eb72-42e7-8570-0e3e78634588 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:55.809538 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43fb8904-eb72-42e7-8570-0e3e78634588 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:55.821491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43fb8904-eb72-42e7-8570-0e3e78634588 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:55.827228 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43fb8904-eb72-42e7-8570-0e3e78634588 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:55.827920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43fb8904-eb72-42e7-8570-0e3e78634588 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:55.828504 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43fb8904-eb72-42e7-8570-0e3e78634588 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:55.973489 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-43fb8904-eb72-42e7-8570-0e3e78634588 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:55.992057 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-43fb8904-eb72-42e7-8570-0e3e78634588 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1187 microversion: 2.1 time: 0.203298 Oct 27 09:38:55.993725 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 169/337] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:55 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1187 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:56.020743 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:56.033623 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:56.048454 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:56.049858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-aad92bd9-eba5-4dea-91ea-035e6305aa85 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.390450 Oct 27 09:38:56.051378 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 169/338] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:55 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:38:56.448295 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-309e1861-ea3c-4595-a6ff-cbab28389015 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:56.449872 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-309e1861-ea3c-4595-a6ff-cbab28389015 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:56.457982 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-309e1861-ea3c-4595-a6ff-cbab28389015 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:56.458574 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-309e1861-ea3c-4595-a6ff-cbab28389015 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:56.459105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-309e1861-ea3c-4595-a6ff-cbab28389015 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:56.460235 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-309e1861-ea3c-4595-a6ff-cbab28389015 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:56.460778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-309e1861-ea3c-4595-a6ff-cbab28389015 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:56.464846 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-309e1861-ea3c-4595-a6ff-cbab28389015 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:56.659873 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-309e1861-ea3c-4595-a6ff-cbab28389015 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:56.668787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-309e1861-ea3c-4595-a6ff-cbab28389015 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1510 microversion: 2.1 time: 0.229377 Oct 27 09:38:56.669956 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 170/339] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:56 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:56.753570 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e14e25e3-a23d-42ab-831c-cf2f95f4136b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:56.755087 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e14e25e3-a23d-42ab-831c-cf2f95f4136b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:56.770862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e14e25e3-a23d-42ab-831c-cf2f95f4136b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:56.785055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e14e25e3-a23d-42ab-831c-cf2f95f4136b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:56.791661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e14e25e3-a23d-42ab-831c-cf2f95f4136b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:56.793170 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e14e25e3-a23d-42ab-831c-cf2f95f4136b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:56.796827 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e14e25e3-a23d-42ab-831c-cf2f95f4136b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:56.797384 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e14e25e3-a23d-42ab-831c-cf2f95f4136b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:57.017084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f332a974-510e-4fcc-b63e-300fca54dd62 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:57.019302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f332a974-510e-4fcc-b63e-300fca54dd62 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:57.031597 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f332a974-510e-4fcc-b63e-300fca54dd62 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:57.032498 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f332a974-510e-4fcc-b63e-300fca54dd62 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:57.035336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f332a974-510e-4fcc-b63e-300fca54dd62 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:57.035336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f332a974-510e-4fcc-b63e-300fca54dd62 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:57.035336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f332a974-510e-4fcc-b63e-300fca54dd62 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:57.035336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f332a974-510e-4fcc-b63e-300fca54dd62 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:57.464988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e14e25e3-a23d-42ab-831c-cf2f95f4136b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:57.474830 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e14e25e3-a23d-42ab-831c-cf2f95f4136b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.725768 Oct 27 09:38:57.492099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 170/340] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:56 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:57.497986 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:57.498859 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:57.505753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:57.506489 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:57.507096 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:57.507988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:57.508643 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:57.509223 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:57.550033 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f332a974-510e-4fcc-b63e-300fca54dd62 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:57.569628 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f332a974-510e-4fcc-b63e-300fca54dd62 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1195 microversion: 2.1 time: 0.556610 Oct 27 09:38:57.571269 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 171/341] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:57 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1195 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:57.691751 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ce28255b-f79b-4f50-9680-424ef86e8118 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:57.692648 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ce28255b-f79b-4f50-9680-424ef86e8118 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:57.700474 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce28255b-f79b-4f50-9680-424ef86e8118 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:57.703266 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce28255b-f79b-4f50-9680-424ef86e8118 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:57.704172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce28255b-f79b-4f50-9680-424ef86e8118 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:57.707976 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce28255b-f79b-4f50-9680-424ef86e8118 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:57.708808 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce28255b-f79b-4f50-9680-424ef86e8118 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:57.709460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce28255b-f79b-4f50-9680-424ef86e8118 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:57.710562 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:57.722985 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:57.724434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:57.727922 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8324c4ae-c4cc-4e6e-b4e3-e3e8923f5950 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.234448 Oct 27 09:38:57.728872 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 171/342] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:57 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:57.904773 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ce28255b-f79b-4f50-9680-424ef86e8118 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:57.916979 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ce28255b-f79b-4f50-9680-424ef86e8118 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1510 microversion: 2.1 time: 0.229399 Oct 27 09:38:57.933399 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 172/343] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:57 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:58.499927 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d7c1afae-56bf-49e1-adda-c339d1bf6378 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:58.500667 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d7c1afae-56bf-49e1-adda-c339d1bf6378 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:58.511953 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7c1afae-56bf-49e1-adda-c339d1bf6378 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:58.512941 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7c1afae-56bf-49e1-adda-c339d1bf6378 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:58.513968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7c1afae-56bf-49e1-adda-c339d1bf6378 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:58.514909 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7c1afae-56bf-49e1-adda-c339d1bf6378 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:58.515504 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7c1afae-56bf-49e1-adda-c339d1bf6378 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:58.516146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d7c1afae-56bf-49e1-adda-c339d1bf6378 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:58.600837 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2df6846a-aed7-4954-a039-7f0c308a01dd tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:58.602366 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2df6846a-aed7-4954-a039-7f0c308a01dd tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:58.628794 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2df6846a-aed7-4954-a039-7f0c308a01dd tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:58.632444 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2df6846a-aed7-4954-a039-7f0c308a01dd tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:58.635799 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2df6846a-aed7-4954-a039-7f0c308a01dd tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:58.641093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2df6846a-aed7-4954-a039-7f0c308a01dd tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:58.644216 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2df6846a-aed7-4954-a039-7f0c308a01dd tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:58.646087 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2df6846a-aed7-4954-a039-7f0c308a01dd tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:58.660600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:38:58.788803 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2df6846a-aed7-4954-a039-7f0c308a01dd tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:58.791802 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d7c1afae-56bf-49e1-adda-c339d1bf6378 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:58.805595 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d7c1afae-56bf-49e1-adda-c339d1bf6378 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.309232 Oct 27 09:38:58.815449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2df6846a-aed7-4954-a039-7f0c308a01dd tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1205 microversion: 2.1 time: 0.218675 Oct 27 09:38:58.816027 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 173/345] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:58 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1205 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:58.825258 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 172/345] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:58 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:38:58.841845 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:58.842684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:58.855823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:58.864808 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:58.864808 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:58.864808 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:58.864808 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:58.865192 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:58.946654 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0f55917b-d303-4297-8709-46789c031262 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:58.947347 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0f55917b-d303-4297-8709-46789c031262 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:58.953519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f55917b-d303-4297-8709-46789c031262 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:58.954375 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f55917b-d303-4297-8709-46789c031262 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:58.954904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f55917b-d303-4297-8709-46789c031262 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:58.955815 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f55917b-d303-4297-8709-46789c031262 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:58.956481 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f55917b-d303-4297-8709-46789c031262 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:58.957000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f55917b-d303-4297-8709-46789c031262 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:59.158350 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:59.170756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:59.172624 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:59.174050 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1f703b73-d19b-4fe7-b56c-0f934bbaff24 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.347493 Oct 27 09:38:59.194722 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 173/346] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:38:58 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:38:59.219978 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0f55917b-d303-4297-8709-46789c031262 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:38:59.235223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0f55917b-d303-4297-8709-46789c031262 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1510 microversion: 2.1 time: 0.292920 Oct 27 09:38:59.235813 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 174/347] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:58 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1510 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:38:59.830966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1b6a3749-42dd-407c-9bd4-0994d463b6e8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:59.831573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1b6a3749-42dd-407c-9bd4-0994d463b6e8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:59.838398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b6a3749-42dd-407c-9bd4-0994d463b6e8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:59.839433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b6a3749-42dd-407c-9bd4-0994d463b6e8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:59.839879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b6a3749-42dd-407c-9bd4-0994d463b6e8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:59.840601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b6a3749-42dd-407c-9bd4-0994d463b6e8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:59.841054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b6a3749-42dd-407c-9bd4-0994d463b6e8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:59.841478 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b6a3749-42dd-407c-9bd4-0994d463b6e8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:59.848382 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7da165e1-67aa-49d7-974a-50810d1059dc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:38:59.849272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7da165e1-67aa-49d7-974a-50810d1059dc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:38:59.872397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7da165e1-67aa-49d7-974a-50810d1059dc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:59.872945 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7da165e1-67aa-49d7-974a-50810d1059dc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:59.873476 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7da165e1-67aa-49d7-974a-50810d1059dc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:38:59.881585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7da165e1-67aa-49d7-974a-50810d1059dc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:38:59.882591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7da165e1-67aa-49d7-974a-50810d1059dc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:38:59.883275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7da165e1-67aa-49d7-974a-50810d1059dc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:00.190019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7da165e1-67aa-49d7-974a-50810d1059dc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:00.198326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7da165e1-67aa-49d7-974a-50810d1059dc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1272 microversion: 2.1 time: 0.355626 Oct 27 09:39:00.205420 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 175/348] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:59 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1272 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:00.210373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:00.214527 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:00.226982 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:00.229765 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:00.230530 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:00.231478 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:00.232181 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1b6a3749-42dd-407c-9bd4-0994d463b6e8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:00.232820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:00.235707 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:00.246768 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1b6a3749-42dd-407c-9bd4-0994d463b6e8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.420094 Oct 27 09:39:00.248506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 174/349] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:38:59 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:00.268508 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6a0128d3-9280-42d0-92bf-c5c0f394ca4b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:00.269524 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6a0128d3-9280-42d0-92bf-c5c0f394ca4b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:00.283115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0128d3-9280-42d0-92bf-c5c0f394ca4b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:00.283879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0128d3-9280-42d0-92bf-c5c0f394ca4b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:00.284553 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0128d3-9280-42d0-92bf-c5c0f394ca4b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:00.286482 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0128d3-9280-42d0-92bf-c5c0f394ca4b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:00.287977 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0128d3-9280-42d0-92bf-c5c0f394ca4b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:00.289053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0128d3-9280-42d0-92bf-c5c0f394ca4b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:00.609089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6a0128d3-9280-42d0-92bf-c5c0f394ca4b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:00.619120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6a0128d3-9280-42d0-92bf-c5c0f394ca4b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1516 microversion: 2.1 time: 0.360309 Oct 27 09:39:00.619707 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 175/350] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:00 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1516 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:00.645724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1139e5dc-7e18-411e-b6cf-4908c0945dc6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "495e25c4-1096-49fc-aba7-ceaa5777afad", "device": "/dev/sdb"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:00.648814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1139e5dc-7e18-411e-b6cf-4908c0945dc6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:00.661114 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1139e5dc-7e18-411e-b6cf-4908c0945dc6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:00.662121 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1139e5dc-7e18-411e-b6cf-4908c0945dc6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:00.662121 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1139e5dc-7e18-411e-b6cf-4908c0945dc6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:00.662833 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1139e5dc-7e18-411e-b6cf-4908c0945dc6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:00.665215 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1139e5dc-7e18-411e-b6cf-4908c0945dc6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:00.665659 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1139e5dc-7e18-411e-b6cf-4908c0945dc6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:00.678056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:00.690740 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:00.692460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:00.695235 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f5694c71-1230-4dbd-ba3b-d792e087ea80 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1744 microversion: 2.20 time: 0.488005 Oct 27 09:39:00.696386 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 176/351] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:00 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1744 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:00.701127 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:01.060495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1139e5dc-7e18-411e-b6cf-4908c0945dc6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "POST /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426082 Oct 27 09:39:01.062180 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 176/352] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:39:00 2022] POST /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:01.230304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cc45d7b7-7f64-4358-936b-ceaaff770cbc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:01.231079 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cc45d7b7-7f64-4358-936b-ceaaff770cbc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:01.240251 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc45d7b7-7f64-4358-936b-ceaaff770cbc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:01.240727 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc45d7b7-7f64-4358-936b-ceaaff770cbc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:01.241485 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc45d7b7-7f64-4358-936b-ceaaff770cbc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:01.246163 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc45d7b7-7f64-4358-936b-ceaaff770cbc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:01.246725 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc45d7b7-7f64-4358-936b-ceaaff770cbc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:01.251154 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc45d7b7-7f64-4358-936b-ceaaff770cbc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:01.275994 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3819ced5-a6e3-45f8-b1f2-d80547eaadd1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:01.276991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-3819ced5-a6e3-45f8-b1f2-d80547eaadd1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:01.289779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3819ced5-a6e3-45f8-b1f2-d80547eaadd1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:01.289779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3819ced5-a6e3-45f8-b1f2-d80547eaadd1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:01.289779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3819ced5-a6e3-45f8-b1f2-d80547eaadd1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:01.290774 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3819ced5-a6e3-45f8-b1f2-d80547eaadd1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:01.291176 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3819ced5-a6e3-45f8-b1f2-d80547eaadd1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:01.291604 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3819ced5-a6e3-45f8-b1f2-d80547eaadd1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:01.716336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cc45d7b7-7f64-4358-936b-ceaaff770cbc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:01.734151 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-3819ced5-a6e3-45f8-b1f2-d80547eaadd1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:01.741778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cc45d7b7-7f64-4358-936b-ceaaff770cbc tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.503798 Oct 27 09:39:01.743709 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 177/353] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:01 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:01.751099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3819ced5-a6e3-45f8-b1f2-d80547eaadd1 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.478195 Oct 27 09:39:01.753939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 177/354] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:01 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:01.758462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-8d70ee14-d80d-4e6e-8be0-f9c5965365df req-9d561ed3-1241-4c57-9620-301f9f1b2c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596c5c1c-3555-40e9-a2d3-6c6300478846", "tag": "af533890-8a09-4e93-ac93-881cbb38ca23"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:01.766800 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:01.767986 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:01.782138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:01.782897 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:01.783523 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:01.783658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-8d70ee14-d80d-4e6e-8be0-f9c5965365df req-9d561ed3-1241-4c57-9620-301f9f1b2c81 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:01.784003 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-8d70ee14-d80d-4e6e-8be0-f9c5965365df req-9d561ed3-1241-4c57-9620-301f9f1b2c81 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:01.785427 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-8d70ee14-d80d-4e6e-8be0-f9c5965365df req-9d561ed3-1241-4c57-9620-301f9f1b2c81 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:01.789459 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:01.790141 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:01.790551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:01.802984 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-8d70ee14-d80d-4e6e-8be0-f9c5965365df req-9d561ed3-1241-4c57-9620-301f9f1b2c81 service nova] Creating event network-changed:af533890-8a09-4e93-ac93-881cbb38ca23 for instance 596c5c1c-3555-40e9-a2d3-6c6300478846 on hv-cinder-79797 Oct 27 09:39:01.810449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-8d70ee14-d80d-4e6e-8be0-f9c5965365df req-9d561ed3-1241-4c57-9620-301f9f1b2c81 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062716 Oct 27 09:39:01.811294 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 178/355] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:02.058931 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:02.067440 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:02.072011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:02.074691 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ce35a996-2126-4812-8e9c-515b42fe7fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1744 microversion: 2.20 time: 0.318570 Oct 27 09:39:02.075881 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 178/356] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:01 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1744 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:02.268974 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-978d7be7-a3be-49ed-809c-ea3330841cd4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'create', calling method: .version_select at 0x7f3649500f70>, body: {"keypair": {"name": "tempest-keypair-1179485229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElQinWysgQatlnsXVYNhNxl7XjBkBIAAUcATPPyNSy2ja+yVNPNixn2KXgqmjT5mnz+q9aIrf5AE5zRAvu4h1cZxCzf6VVrtqZFNoTyf5GoGRbZe/Nw/xjhKDey12jSkw=="}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:02.289094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-978d7be7-a3be-49ed-809c-ea3330841cd4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Getting quotas for project df306d37ff634f7eaad80fc3bc65b653. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:39:02.293338 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-978d7be7-a3be-49ed-809c-ea3330841cd4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Getting quotas for user 20c65ed67cd8403489949c4dea572d01 and project df306d37ff634f7eaad80fc3bc65b653. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:39:02.320383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-978d7be7-a3be-49ed-809c-ea3330841cd4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055734 Oct 27 09:39:02.321034 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 179/357] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Oct 27 09:39:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:02.770640 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-243d0bd3-37e1-499b-b627-3db46ed8d449 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:02.771738 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-243d0bd3-37e1-499b-b627-3db46ed8d449 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:02.775185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ce6e262c-a507-4a08-a3cd-7fe2d77e8fbf tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:02.776261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ce6e262c-a507-4a08-a3cd-7fe2d77e8fbf tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:02.778915 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-243d0bd3-37e1-499b-b627-3db46ed8d449 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:02.779526 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-243d0bd3-37e1-499b-b627-3db46ed8d449 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:02.780019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:02.780458 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-243d0bd3-37e1-499b-b627-3db46ed8d449 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:02.781551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-243d0bd3-37e1-499b-b627-3db46ed8d449 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:02.782154 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-243d0bd3-37e1-499b-b627-3db46ed8d449 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:02.782823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-243d0bd3-37e1-499b-b627-3db46ed8d449 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:02.796759 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce6e262c-a507-4a08-a3cd-7fe2d77e8fbf tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:02.804728 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce6e262c-a507-4a08-a3cd-7fe2d77e8fbf tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:02.805690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce6e262c-a507-4a08-a3cd-7fe2d77e8fbf tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:02.808770 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce6e262c-a507-4a08-a3cd-7fe2d77e8fbf tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:02.812329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce6e262c-a507-4a08-a3cd-7fe2d77e8fbf tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:02.813029 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ce6e262c-a507-4a08-a3cd-7fe2d77e8fbf tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:03.109873 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-243d0bd3-37e1-499b-b627-3db46ed8d449 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:03.119429 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-243d0bd3-37e1-499b-b627-3db46ed8d449 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.352871 Oct 27 09:39:03.121158 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 179/358] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:02 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:03.151228 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:03.151859 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:03.167793 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=80 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:03.169583 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:03.170290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:03.170907 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:03.173389 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:03.174404 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:03.175322 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:03.234507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ce6e262c-a507-4a08-a3cd-7fe2d77e8fbf tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:03.244406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ce6e262c-a507-4a08-a3cd-7fe2d77e8fbf tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.473142 Oct 27 09:39:03.250604 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 180/359] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:02 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:03.431698 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:03.484392 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:03.487934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:03.497412 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-75610082-352f-4409-b982-d2b5ec2b6d22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1744 microversion: 2.20 time: 0.374984 Oct 27 09:39:03.498034 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 180/360] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:03 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1744 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:04.144406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6402816a-8ffa-4c8e-9078-9dc6422537e8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:04.145064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6402816a-8ffa-4c8e-9078-9dc6422537e8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:04.157043 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6402816a-8ffa-4c8e-9078-9dc6422537e8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:04.157797 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6402816a-8ffa-4c8e-9078-9dc6422537e8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:04.158425 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6402816a-8ffa-4c8e-9078-9dc6422537e8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:04.159307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6402816a-8ffa-4c8e-9078-9dc6422537e8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:04.159918 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6402816a-8ffa-4c8e-9078-9dc6422537e8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:04.160498 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6402816a-8ffa-4c8e-9078-9dc6422537e8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:04.233230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:04.277540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-de87dc35-4c7a-4c6f-8862-ce5c8b8ef502 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:04.278750 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-de87dc35-4c7a-4c6f-8862-ce5c8b8ef502 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:04.290845 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de87dc35-4c7a-4c6f-8862-ce5c8b8ef502 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:04.291594 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de87dc35-4c7a-4c6f-8862-ce5c8b8ef502 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:04.293709 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de87dc35-4c7a-4c6f-8862-ce5c8b8ef502 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:04.294944 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de87dc35-4c7a-4c6f-8862-ce5c8b8ef502 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:04.298336 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de87dc35-4c7a-4c6f-8862-ce5c8b8ef502 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:04.303237 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de87dc35-4c7a-4c6f-8862-ce5c8b8ef502 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:04.358600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6402816a-8ffa-4c8e-9078-9dc6422537e8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:04.366847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6402816a-8ffa-4c8e-9078-9dc6422537e8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.226261 Oct 27 09:39:04.377931 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 181/361] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:04 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:04.524894 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:04.525779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:04.544555 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:04.545444 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:04.546057 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:04.547141 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:04.548344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:04.550902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:04.710099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-de87dc35-4c7a-4c6f-8862-ce5c8b8ef502 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:04.722312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-de87dc35-4c7a-4c6f-8862-ce5c8b8ef502 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.452569 Oct 27 09:39:04.723531 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 181/362] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:04 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:04.728875 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1508712119", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "778ab2d7-84d8-46e7-a293-9e88d4d9fee2"}], "security_groups": [{"name": "tempest-securitygroup--1446951875"}], "key_name": "tempest-keypair-1179485229", "user_data": "}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:04.765730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:04.813071 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:04.822040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:04.826647 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:04.828177 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f7cb74b4-8c5e-4097-b911-de03566e40a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.307441 Oct 27 09:39:04.839794 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 182/363] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:04 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:39:05.426180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1aca703d-4d2a-4646-970d-fbdc7c18c224 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:05.426930 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1aca703d-4d2a-4646-970d-fbdc7c18c224 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:05.434214 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1aca703d-4d2a-4646-970d-fbdc7c18c224 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:05.434696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1aca703d-4d2a-4646-970d-fbdc7c18c224 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:05.435124 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1aca703d-4d2a-4646-970d-fbdc7c18c224 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:05.435820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1aca703d-4d2a-4646-970d-fbdc7c18c224 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:05.436263 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1aca703d-4d2a-4646-970d-fbdc7c18c224 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:05.450668 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1aca703d-4d2a-4646-970d-fbdc7c18c224 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:05.761853 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1aca703d-4d2a-4646-970d-fbdc7c18c224 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:05.782955 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1aca703d-4d2a-4646-970d-fbdc7c18c224 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.360690 Oct 27 09:39:05.792551 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 183/364] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:05 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:05.792551 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-14035a05-b248-47b3-a996-277ba591b3f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:05.792551 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-14035a05-b248-47b3-a996-277ba591b3f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:05.803161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-14035a05-b248-47b3-a996-277ba591b3f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:05.808241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-14035a05-b248-47b3-a996-277ba591b3f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:05.809028 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-14035a05-b248-47b3-a996-277ba591b3f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:05.809950 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-14035a05-b248-47b3-a996-277ba591b3f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:05.811246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-14035a05-b248-47b3-a996-277ba591b3f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:05.812109 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-14035a05-b248-47b3-a996-277ba591b3f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:06.108782 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-14035a05-b248-47b3-a996-277ba591b3f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:06.125267 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-14035a05-b248-47b3-a996-277ba591b3f3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1722 microversion: 2.1 time: 0.340117 Oct 27 09:39:06.141583 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 184/365] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:05 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:06.149114 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:06.150241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:06.159653 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:06.160455 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:06.161638 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:06.162780 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:06.163400 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:06.163972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:06.429900 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:06.441210 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:06.448982 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:06.458234 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-32245bca-6822-481d-b29a-0c9532c7d8c9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.315104 Oct 27 09:39:06.464916 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 185/366] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:06 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:06.476331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-3a135058-b598-43d3-a8e9-7a24303d11f7 req-114adac8-576c-4260-bb6a-58a784d9170c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac6a130-38c4-4843-b9a8-118d25c11c18", "name": "network-vif-plugged", "status": "completed", "tag": "0e6b0478-48aa-4f67-86d8-eb4b392e3971"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:06.494989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-3a135058-b598-43d3-a8e9-7a24303d11f7 req-114adac8-576c-4260-bb6a-58a784d9170c service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:06.495472 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-3a135058-b598-43d3-a8e9-7a24303d11f7 req-114adac8-576c-4260-bb6a-58a784d9170c service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:06.501491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-3a135058-b598-43d3-a8e9-7a24303d11f7 req-114adac8-576c-4260-bb6a-58a784d9170c service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:06.518829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-3a135058-b598-43d3-a8e9-7a24303d11f7 req-114adac8-576c-4260-bb6a-58a784d9170c service nova] Creating event network-vif-plugged:0e6b0478-48aa-4f67-86d8-eb4b392e3971 for instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 on hv-cinder-79797 Oct 27 09:39:06.529522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-3a135058-b598-43d3-a8e9-7a24303d11f7 req-114adac8-576c-4260-bb6a-58a784d9170c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056618 Oct 27 09:39:06.530117 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 186/367] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:06.811737 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c1363c2d-967e-4388-a054-e582e77eebcf tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:06.812503 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c1363c2d-967e-4388-a054-e582e77eebcf tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:06.822036 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c1363c2d-967e-4388-a054-e582e77eebcf tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:06.822529 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c1363c2d-967e-4388-a054-e582e77eebcf tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:06.823006 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c1363c2d-967e-4388-a054-e582e77eebcf tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:06.823719 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c1363c2d-967e-4388-a054-e582e77eebcf tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:06.824458 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c1363c2d-967e-4388-a054-e582e77eebcf tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:06.824977 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c1363c2d-967e-4388-a054-e582e77eebcf tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:07.030613 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c1363c2d-967e-4388-a054-e582e77eebcf tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:07.040352 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c1363c2d-967e-4388-a054-e582e77eebcf tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.233884 Oct 27 09:39:07.057102 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 187/368] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:06 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:07.152895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-52667db7-ef4b-4b9b-8f7d-0acd2004d1c3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:07.153503 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-52667db7-ef4b-4b9b-8f7d-0acd2004d1c3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:07.165031 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52667db7-ef4b-4b9b-8f7d-0acd2004d1c3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:07.165521 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52667db7-ef4b-4b9b-8f7d-0acd2004d1c3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:07.165954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52667db7-ef4b-4b9b-8f7d-0acd2004d1c3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:07.167197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52667db7-ef4b-4b9b-8f7d-0acd2004d1c3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:07.167653 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52667db7-ef4b-4b9b-8f7d-0acd2004d1c3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:07.168074 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-52667db7-ef4b-4b9b-8f7d-0acd2004d1c3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:07.356822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-52667db7-ef4b-4b9b-8f7d-0acd2004d1c3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:07.365546 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-52667db7-ef4b-4b9b-8f7d-0acd2004d1c3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1699 microversion: 2.1 time: 0.216381 Oct 27 09:39:07.366587 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 188/369] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:07 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1699 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:07.389712 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-92a2ae3e-343e-45bf-ba08-4d753d504407 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:07.396959 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-92a2ae3e-343e-45bf-ba08-4d753d504407 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:07.396959 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-92a2ae3e-343e-45bf-ba08-4d753d504407 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:07.397429 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-92a2ae3e-343e-45bf-ba08-4d753d504407 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:07.481443 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-92a2ae3e-343e-45bf-ba08-4d753d504407 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Going to try to start instance {{(pid=125361) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 09:39:07.542335 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-92a2ae3e-343e-45bf-ba08-4d753d504407 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/action" status: 202 len: 0 microversion: 2.1 time: 0.157290 Oct 27 09:39:07.546863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 189/370] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:39:07 2022] POST /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:39:07.547042 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] validate_networks() for [('778ab2d7-84d8-46e7-a293-9e88d4d9fee2', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:39:07.557865 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a1736a63-0e5b-4ba1-9b58-07d71e8d4067 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Action: 'create', calling method: .version_select at 0x7f3649771700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1548663723", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVXOTt8bqLRKcUhVa37SArRt6DZJGwcOdI/MvM7rdZoLCMgJgJ1qLUjaEzcBOukFMV9wSpyGZuorfc6xdgM8Po59VOdSxKvXYWKhIpe+4u1it5bq+N0E9nEquO/40dLSw=="}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:07.575530 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-a1736a63-0e5b-4ba1-9b58-07d71e8d4067 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Getting quotas for project f169a47a4c9a4c60b87cedcd77c102c8. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:39:07.580237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-a1736a63-0e5b-4ba1-9b58-07d71e8d4067 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Getting quotas for user 51aba36d56c94e2fa351aa098dc0a962 and project f169a47a4c9a4c60b87cedcd77c102c8. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:39:07.608090 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a1736a63-0e5b-4ba1-9b58-07d71e8d4067 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058688 Oct 27 09:39:07.620606 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 190/371] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Oct 27 09:39:07 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:07.625617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:07.626390 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:07.632927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:07.634309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:07.634309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:07.634538 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:07.634974 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:07.635956 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:07.919881 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:07.935380 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:07.937239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:07.938560 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-02230f8f-fbeb-47a4-904e-7820923c36ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.316948 Oct 27 09:39:07.948487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 191/372] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:07 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:07.948487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-99cb2a1d-e866-4a2b-be85-6a436f64c408 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:07.948487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-99cb2a1d-e866-4a2b-be85-6a436f64c408 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:07.953882 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-99cb2a1d-e866-4a2b-be85-6a436f64c408 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:07.955035 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-99cb2a1d-e866-4a2b-be85-6a436f64c408 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:07.955652 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-99cb2a1d-e866-4a2b-be85-6a436f64c408 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:07.957035 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-99cb2a1d-e866-4a2b-be85-6a436f64c408 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:07.957674 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-99cb2a1d-e866-4a2b-be85-6a436f64c408 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:07.958106 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-99cb2a1d-e866-4a2b-be85-6a436f64c408 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:07.964118 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:08.370131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:39:08.370870 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:39:08.371463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:39:08.371984 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:39:08.372549 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:39:08.382550 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:08.383393 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:08.384057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:08.385028 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:08.385730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:08.386220 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:08.399749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-99cb2a1d-e866-4a2b-be85-6a436f64c408 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:08.409885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Getting quotas for project df306d37ff634f7eaad80fc3bc65b653. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:39:08.410437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-99cb2a1d-e866-4a2b-be85-6a436f64c408 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1708 microversion: 2.1 time: 0.470117 Oct 27 09:39:08.411739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 192/373] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:07 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1708 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:08.415048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Getting quotas for user 20c65ed67cd8403489949c4dea572d01 and project df306d37ff634f7eaad80fc3bc65b653. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:39:08.418609 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-903169114", "imageRef": "d82732d8-581f-411e-b8c6-3e00e8f05abc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1548663723", "networks": [{"uuid": "042524b8-b6d1-4da2-af4f-a673e3c2f198"}]}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:08.432820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:39:08.435437 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:39:08.478400 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.network.neutron [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] validate_networks() for [('042524b8-b6d1-4da2-af4f-a673e3c2f198', None, None, None, None, None)] {{(pid=125361) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:39:08.517410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9f84ab6d-dc10-4903-9d79-f4970e3f8127 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.792559 Oct 27 09:39:08.520055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 182/374] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:39:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 3796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:39:08.534183 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-32ea4fda-7538-493f-8fea-164423985cae tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:08.537135 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-32ea4fda-7538-493f-8fea-164423985cae tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:08.545819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32ea4fda-7538-493f-8fea-164423985cae tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:08.546561 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32ea4fda-7538-493f-8fea-164423985cae tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:08.547275 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32ea4fda-7538-493f-8fea-164423985cae tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:08.547835 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32ea4fda-7538-493f-8fea-164423985cae tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:08.548449 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32ea4fda-7538-493f-8fea-164423985cae tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:08.549453 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32ea4fda-7538-493f-8fea-164423985cae tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:08.866467 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-32ea4fda-7538-493f-8fea-164423985cae tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:08.883439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-32ea4fda-7538-493f-8fea-164423985cae tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.361294 Oct 27 09:39:08.900534 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 183/375] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:08 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:08.906553 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5dc71991-d578-47b4-b41e-bd13d4da7928 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:08.907980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5dc71991-d578-47b4-b41e-bd13d4da7928 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:09.063661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5dc71991-d578-47b4-b41e-bd13d4da7928 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:09.072156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5dc71991-d578-47b4-b41e-bd13d4da7928 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1246 microversion: 2.1 time: 0.169727 Oct 27 09:39:09.075415 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 184/376] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:08 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1246 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:09.097501 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:09.102005 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:09.113498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:09.114335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:09.115132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:09.116091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:09.116865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:09.117457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:09.433590 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:09.449110 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:09.451898 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:09.454655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ac680dfd-335c-42d5-8bb8-5b5d2f010bad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.372038 Oct 27 09:39:09.456066 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 185/377] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:09 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:09.462061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-82fb9298-beae-4052-a778-c0213ea4abaa tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:09.462881 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-82fb9298-beae-4052-a778-c0213ea4abaa tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:09.474886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82fb9298-beae-4052-a778-c0213ea4abaa tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:09.475650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82fb9298-beae-4052-a778-c0213ea4abaa tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:09.476411 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82fb9298-beae-4052-a778-c0213ea4abaa tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:09.477334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82fb9298-beae-4052-a778-c0213ea4abaa tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:09.477948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82fb9298-beae-4052-a778-c0213ea4abaa tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:09.478529 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-82fb9298-beae-4052-a778-c0213ea4abaa tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:09.673422 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Flavor limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:39:09.674545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Image limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:39:09.675097 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Flavor pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:39:09.675585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Image pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:39:09.676078 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:39:09.687332 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:09.688184 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:09.688906 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:09.689915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:09.690617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:09.691281 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:09.710179 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Getting quotas for project f169a47a4c9a4c60b87cedcd77c102c8. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:39:09.738329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Getting quotas for user 51aba36d56c94e2fa351aa098dc0a962 and project f169a47a4c9a4c60b87cedcd77c102c8. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:39:09.774413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Going to run 1 instances... {{(pid=125361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:39:09.778220 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d82732d8-581f-411e-b8c6-3e00e8f05abc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:39:09.781259 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-82fb9298-beae-4052-a778-c0213ea4abaa tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:09.794184 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-82fb9298-beae-4052-a778-c0213ea4abaa tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1708 microversion: 2.1 time: 0.336928 Oct 27 09:39:09.796418 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 186/378] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:09 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1708 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:09.844643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e21df9a7-b1c9-411c-83a3-e05df2130cba tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.431823 Oct 27 09:39:09.846075 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 193/379] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:39:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1433 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:39:09.857693 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-aee5269d-e4ae-41a0-9b82-4fe34eb19f8b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:09.858380 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-aee5269d-e4ae-41a0-9b82-4fe34eb19f8b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:09.908298 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0397a655-9943-4153-9b59-ba9e7bd1a89b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:09.909187 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0397a655-9943-4153-9b59-ba9e7bd1a89b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:09.918711 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0397a655-9943-4153-9b59-ba9e7bd1a89b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:09.919443 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0397a655-9943-4153-9b59-ba9e7bd1a89b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:09.920100 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0397a655-9943-4153-9b59-ba9e7bd1a89b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:09.920841 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0397a655-9943-4153-9b59-ba9e7bd1a89b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:09.921478 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0397a655-9943-4153-9b59-ba9e7bd1a89b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:09.922062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0397a655-9943-4153-9b59-ba9e7bd1a89b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:09.984172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-aee5269d-e4ae-41a0-9b82-4fe34eb19f8b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:09.994521 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-aee5269d-e4ae-41a0-9b82-4fe34eb19f8b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1258 microversion: 2.1 time: 0.140894 Oct 27 09:39:09.996556 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 187/380] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:09 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1258 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:10.097183 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fcba026c-94c0-4279-97e8-612f406ee3b4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:10.098016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fcba026c-94c0-4279-97e8-612f406ee3b4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:10.106187 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcba026c-94c0-4279-97e8-612f406ee3b4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:10.109497 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcba026c-94c0-4279-97e8-612f406ee3b4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:10.110171 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcba026c-94c0-4279-97e8-612f406ee3b4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:10.111088 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcba026c-94c0-4279-97e8-612f406ee3b4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:10.113811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcba026c-94c0-4279-97e8-612f406ee3b4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:10.114477 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcba026c-94c0-4279-97e8-612f406ee3b4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:10.262142 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fcba026c-94c0-4279-97e8-612f406ee3b4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:10.278863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fcba026c-94c0-4279-97e8-612f406ee3b4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1298 microversion: 2.1 time: 0.185711 Oct 27 09:39:10.279456 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 188/381] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:10 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:10.284738 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0397a655-9943-4153-9b59-ba9e7bd1a89b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:10.293053 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0397a655-9943-4153-9b59-ba9e7bd1a89b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.388905 Oct 27 09:39:10.308897 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 194/382] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:09 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:10.487768 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:10.488636 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:10.517812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:10.519795 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:10.520295 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:10.522924 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:10.526647 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:10.527146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:10.741558 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:10.751132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:10.752613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:10.754024 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-26334067-8e9d-4b2c-9b74-07621db2aa2d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.271999 Oct 27 09:39:10.754741 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 189/383] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:10 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:10.820480 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5aacd717-6da1-4233-b51f-59c5acfd9191 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:10.821119 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5aacd717-6da1-4233-b51f-59c5acfd9191 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:10.827561 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5aacd717-6da1-4233-b51f-59c5acfd9191 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:10.828248 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5aacd717-6da1-4233-b51f-59c5acfd9191 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:10.829141 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5aacd717-6da1-4233-b51f-59c5acfd9191 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:10.829995 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5aacd717-6da1-4233-b51f-59c5acfd9191 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:10.830632 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5aacd717-6da1-4233-b51f-59c5acfd9191 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:10.831058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5aacd717-6da1-4233-b51f-59c5acfd9191 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:10.982449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5aacd717-6da1-4233-b51f-59c5acfd9191 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:10.994072 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5aacd717-6da1-4233-b51f-59c5acfd9191 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1708 microversion: 2.1 time: 0.177502 Oct 27 09:39:10.995383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 195/384] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:10 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1708 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:11.020980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6a68f45f-6937-40f6-8813-6f839d3303c7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:11.021806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6a68f45f-6937-40f6-8813-6f839d3303c7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:11.030281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a68f45f-6937-40f6-8813-6f839d3303c7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:11.030771 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a68f45f-6937-40f6-8813-6f839d3303c7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:11.031413 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a68f45f-6937-40f6-8813-6f839d3303c7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:11.032295 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a68f45f-6937-40f6-8813-6f839d3303c7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:11.032957 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a68f45f-6937-40f6-8813-6f839d3303c7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:11.033548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a68f45f-6937-40f6-8813-6f839d3303c7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:11.095836 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6a68f45f-6937-40f6-8813-6f839d3303c7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:11.104936 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6a68f45f-6937-40f6-8813-6f839d3303c7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1262 microversion: 2.1 time: 0.087278 Oct 27 09:39:11.105890 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 190/385] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:11 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:11.303442 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f482ed98-26f6-40e5-ab05-7b43e0f5f7a8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:11.304056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f482ed98-26f6-40e5-ab05-7b43e0f5f7a8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:11.312980 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f482ed98-26f6-40e5-ab05-7b43e0f5f7a8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:11.313718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f482ed98-26f6-40e5-ab05-7b43e0f5f7a8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:11.314348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f482ed98-26f6-40e5-ab05-7b43e0f5f7a8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:11.315059 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f482ed98-26f6-40e5-ab05-7b43e0f5f7a8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:11.315513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f482ed98-26f6-40e5-ab05-7b43e0f5f7a8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:11.315941 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f482ed98-26f6-40e5-ab05-7b43e0f5f7a8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:11.320981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4f88aa3d-1c7e-46ac-9b86-f7267a8ff971 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:11.321846 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4f88aa3d-1c7e-46ac-9b86-f7267a8ff971 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:11.328217 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4f88aa3d-1c7e-46ac-9b86-f7267a8ff971 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:11.328994 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4f88aa3d-1c7e-46ac-9b86-f7267a8ff971 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:11.329422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4f88aa3d-1c7e-46ac-9b86-f7267a8ff971 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:11.330115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4f88aa3d-1c7e-46ac-9b86-f7267a8ff971 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:11.330561 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4f88aa3d-1c7e-46ac-9b86-f7267a8ff971 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:11.330976 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4f88aa3d-1c7e-46ac-9b86-f7267a8ff971 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:11.454227 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f482ed98-26f6-40e5-ab05-7b43e0f5f7a8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:11.467505 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f482ed98-26f6-40e5-ab05-7b43e0f5f7a8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1304 microversion: 2.1 time: 0.168060 Oct 27 09:39:11.492532 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 196/386] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:11 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:11.563888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4f88aa3d-1c7e-46ac-9b86-f7267a8ff971 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:11.578888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4f88aa3d-1c7e-46ac-9b86-f7267a8ff971 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.264772 Oct 27 09:39:11.579508 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 191/387] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:11 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:11.779849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:11.780461 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:11.786814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:11.787309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:11.787750 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:11.788452 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:11.788947 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:11.789374 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:11.943536 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:11.953799 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:11.955838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:11.957282 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b9e4f31e-0961-4ca3-bc6c-301dd822b78e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.181826 Oct 27 09:39:11.957964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 197/388] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:11 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:12.021029 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9284f018-f65c-4731-8579-855c445511b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:12.021682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9284f018-f65c-4731-8579-855c445511b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:12.029368 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9284f018-f65c-4731-8579-855c445511b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:12.030098 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9284f018-f65c-4731-8579-855c445511b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:12.030712 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9284f018-f65c-4731-8579-855c445511b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:12.031596 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9284f018-f65c-4731-8579-855c445511b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:12.032224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9284f018-f65c-4731-8579-855c445511b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:12.032840 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9284f018-f65c-4731-8579-855c445511b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:12.128387 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ba8b0e85-133b-485e-b390-51cabc214c25 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:12.129110 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ba8b0e85-133b-485e-b390-51cabc214c25 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:12.136848 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ba8b0e85-133b-485e-b390-51cabc214c25 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:12.137625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ba8b0e85-133b-485e-b390-51cabc214c25 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:12.138120 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ba8b0e85-133b-485e-b390-51cabc214c25 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:12.139017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ba8b0e85-133b-485e-b390-51cabc214c25 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:12.139664 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ba8b0e85-133b-485e-b390-51cabc214c25 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:12.140240 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ba8b0e85-133b-485e-b390-51cabc214c25 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:12.196623 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9284f018-f65c-4731-8579-855c445511b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:12.206534 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9284f018-f65c-4731-8579-855c445511b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1708 microversion: 2.1 time: 0.190950 Oct 27 09:39:12.214396 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 192/389] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:12 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1708 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:12.220854 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ba8b0e85-133b-485e-b390-51cabc214c25 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:12.230376 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ba8b0e85-133b-485e-b390-51cabc214c25 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1262 microversion: 2.1 time: 0.105886 Oct 27 09:39:12.231114 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 198/390] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:12 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1262 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:12.491326 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-30fb3cff-ac09-42de-b3c8-23bff58d772d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:12.492389 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-30fb3cff-ac09-42de-b3c8-23bff58d772d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:12.499686 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-30fb3cff-ac09-42de-b3c8-23bff58d772d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:12.500938 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-30fb3cff-ac09-42de-b3c8-23bff58d772d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:12.501375 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-30fb3cff-ac09-42de-b3c8-23bff58d772d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:12.502325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-30fb3cff-ac09-42de-b3c8-23bff58d772d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:12.502782 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-30fb3cff-ac09-42de-b3c8-23bff58d772d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:12.503202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-30fb3cff-ac09-42de-b3c8-23bff58d772d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:12.580184 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-30fb3cff-ac09-42de-b3c8-23bff58d772d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:12.588159 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-30fb3cff-ac09-42de-b3c8-23bff58d772d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1304 microversion: 2.1 time: 0.100699 Oct 27 09:39:12.589677 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 193/391] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:12 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:12.611079 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-34e7f7e2-3e64-41e3-b378-bb53de1db044 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:12.611768 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-34e7f7e2-3e64-41e3-b378-bb53de1db044 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:12.620004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34e7f7e2-3e64-41e3-b378-bb53de1db044 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:12.620484 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34e7f7e2-3e64-41e3-b378-bb53de1db044 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:12.620951 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34e7f7e2-3e64-41e3-b378-bb53de1db044 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:12.621665 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34e7f7e2-3e64-41e3-b378-bb53de1db044 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:12.622092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34e7f7e2-3e64-41e3-b378-bb53de1db044 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:12.622512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-34e7f7e2-3e64-41e3-b378-bb53de1db044 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:12.766964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-34e7f7e2-3e64-41e3-b378-bb53de1db044 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:12.774688 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-34e7f7e2-3e64-41e3-b378-bb53de1db044 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.168845 Oct 27 09:39:12.783820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 199/392] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:12 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:12.983836 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:12.984446 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:12.990484 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:12.990971 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:12.991411 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:12.992095 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:12.994689 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:12.995897 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:13.019014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:13.147106 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:13.156604 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:13.158571 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:13.159994 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5514eb53-86b6-4ac2-be79-0a20db1b9661 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.180623 Oct 27 09:39:13.160567 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 194/393] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:12 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:13.237545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-15167ffc-fc8c-461e-9248-3b2f9f481c99 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:13.238789 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-15167ffc-fc8c-461e-9248-3b2f9f481c99 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:13.246305 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15167ffc-fc8c-461e-9248-3b2f9f481c99 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:13.247004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15167ffc-fc8c-461e-9248-3b2f9f481c99 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:13.247440 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15167ffc-fc8c-461e-9248-3b2f9f481c99 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:13.248455 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15167ffc-fc8c-461e-9248-3b2f9f481c99 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:13.249173 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15167ffc-fc8c-461e-9248-3b2f9f481c99 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:13.249817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15167ffc-fc8c-461e-9248-3b2f9f481c99 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:13.253143 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ee87e276-261b-4c5a-8f16-6b75b9df5103 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:13.253841 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ee87e276-261b-4c5a-8f16-6b75b9df5103 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:13.260350 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee87e276-261b-4c5a-8f16-6b75b9df5103 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:13.261152 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee87e276-261b-4c5a-8f16-6b75b9df5103 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:13.261798 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee87e276-261b-4c5a-8f16-6b75b9df5103 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:13.262721 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee87e276-261b-4c5a-8f16-6b75b9df5103 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:13.263515 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee87e276-261b-4c5a-8f16-6b75b9df5103 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:13.264203 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee87e276-261b-4c5a-8f16-6b75b9df5103 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:13.363806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ee87e276-261b-4c5a-8f16-6b75b9df5103 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:13.374043 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ee87e276-261b-4c5a-8f16-6b75b9df5103 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1262 microversion: 2.1 time: 0.125074 Oct 27 09:39:13.391296 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 195/394] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:13 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1262 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:13.433422 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-15167ffc-fc8c-461e-9248-3b2f9f481c99 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:13.441892 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-15167ffc-fc8c-461e-9248-3b2f9f481c99 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1708 microversion: 2.1 time: 0.208143 Oct 27 09:39:13.442778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 200/395] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:13 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1708 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:13.618620 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8218d018-5872-4bb2-ab3a-a58cbcaa300f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:13.619870 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8218d018-5872-4bb2-ab3a-a58cbcaa300f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:13.634574 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8218d018-5872-4bb2-ab3a-a58cbcaa300f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:13.636774 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8218d018-5872-4bb2-ab3a-a58cbcaa300f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:13.637402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8218d018-5872-4bb2-ab3a-a58cbcaa300f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:13.638310 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8218d018-5872-4bb2-ab3a-a58cbcaa300f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:13.639081 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8218d018-5872-4bb2-ab3a-a58cbcaa300f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:13.639809 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8218d018-5872-4bb2-ab3a-a58cbcaa300f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:13.721366 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8218d018-5872-4bb2-ab3a-a58cbcaa300f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:13.732802 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8218d018-5872-4bb2-ab3a-a58cbcaa300f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1304 microversion: 2.1 time: 0.118825 Oct 27 09:39:13.736680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 196/396] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:13 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:13.799720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c08bf435-2acb-4ef2-aff4-f456b933a2cb tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:13.800636 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c08bf435-2acb-4ef2-aff4-f456b933a2cb tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:13.809429 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c08bf435-2acb-4ef2-aff4-f456b933a2cb tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:13.810284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c08bf435-2acb-4ef2-aff4-f456b933a2cb tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:13.810897 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c08bf435-2acb-4ef2-aff4-f456b933a2cb tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:13.812306 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c08bf435-2acb-4ef2-aff4-f456b933a2cb tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:13.813108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c08bf435-2acb-4ef2-aff4-f456b933a2cb tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:13.814008 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c08bf435-2acb-4ef2-aff4-f456b933a2cb tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:14.081047 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c08bf435-2acb-4ef2-aff4-f456b933a2cb tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:14.090068 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c08bf435-2acb-4ef2-aff4-f456b933a2cb tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.295300 Oct 27 09:39:14.091310 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 201/397] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:13 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:14.186578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:14.188113 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:14.202642 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:14.203712 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:14.204540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:14.205463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:14.206320 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:14.206974 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:14.388273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:14.397599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:14.397858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-db1986f0-766a-4eef-9b5f-44019316c7e7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:14.399054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:14.399202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-db1986f0-766a-4eef-9b5f-44019316c7e7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:14.400241 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b5123c48-110a-4a06-a4fc-4cfcd4810104 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.217525 Oct 27 09:39:14.415321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db1986f0-766a-4eef-9b5f-44019316c7e7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:14.416133 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db1986f0-766a-4eef-9b5f-44019316c7e7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:14.417297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 197/398] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:14 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:14.417646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db1986f0-766a-4eef-9b5f-44019316c7e7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:14.418565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db1986f0-766a-4eef-9b5f-44019316c7e7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:14.419208 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db1986f0-766a-4eef-9b5f-44019316c7e7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:14.419825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db1986f0-766a-4eef-9b5f-44019316c7e7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:14.469609 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4ba5c26c-110e-4029-968f-d6ee09b05897 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:14.470707 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4ba5c26c-110e-4029-968f-d6ee09b05897 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:14.477933 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26c-110e-4029-968f-d6ee09b05897 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:14.478444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26c-110e-4029-968f-d6ee09b05897 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:14.479482 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26c-110e-4029-968f-d6ee09b05897 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:14.480282 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26c-110e-4029-968f-d6ee09b05897 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:14.480778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26c-110e-4029-968f-d6ee09b05897 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:14.481370 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ba5c26c-110e-4029-968f-d6ee09b05897 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:14.498698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-db1986f0-766a-4eef-9b5f-44019316c7e7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:14.507123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-db1986f0-766a-4eef-9b5f-44019316c7e7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1310 microversion: 2.1 time: 0.112960 Oct 27 09:39:14.524132 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 202/399] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:14 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1310 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:14.707068 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4ba5c26c-110e-4029-968f-d6ee09b05897 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:14.727247 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4ba5c26c-110e-4029-968f-d6ee09b05897 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1712 microversion: 2.1 time: 0.263783 Oct 27 09:39:14.734792 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 198/400] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:14 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1712 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:14.762838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f858c285-35e0-4c10-a66f-1fa09c7c4aa0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:14.763616 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f858c285-35e0-4c10-a66f-1fa09c7c4aa0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:14.777301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f858c285-35e0-4c10-a66f-1fa09c7c4aa0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:14.778177 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f858c285-35e0-4c10-a66f-1fa09c7c4aa0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:14.778846 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f858c285-35e0-4c10-a66f-1fa09c7c4aa0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:14.779818 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f858c285-35e0-4c10-a66f-1fa09c7c4aa0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:14.780484 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f858c285-35e0-4c10-a66f-1fa09c7c4aa0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:14.781129 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f858c285-35e0-4c10-a66f-1fa09c7c4aa0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.064547 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f858c285-35e0-4c10-a66f-1fa09c7c4aa0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:15.078162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f858c285-35e0-4c10-a66f-1fa09c7c4aa0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.322312 Oct 27 09:39:15.082304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 203/401] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:14 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:15.115095 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-21104c5f-8829-46fd-9039-25622905069d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:15.115705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-21104c5f-8829-46fd-9039-25622905069d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:15.123833 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21104c5f-8829-46fd-9039-25622905069d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.132917 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21104c5f-8829-46fd-9039-25622905069d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.133583 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21104c5f-8829-46fd-9039-25622905069d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.134493 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21104c5f-8829-46fd-9039-25622905069d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.136430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21104c5f-8829-46fd-9039-25622905069d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.137148 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21104c5f-8829-46fd-9039-25622905069d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.325519 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-21104c5f-8829-46fd-9039-25622905069d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:15.338528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-21104c5f-8829-46fd-9039-25622905069d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.226677 Oct 27 09:39:15.340046 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 199/402] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:15 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:15.427752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:15.429174 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:15.438836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.439919 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.440852 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.441893 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.442681 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.443337 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.531934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a611dcdf-4b23-4193-8881-1a3828f9ca69 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:15.533339 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a611dcdf-4b23-4193-8881-1a3828f9ca69 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:15.551611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a611dcdf-4b23-4193-8881-1a3828f9ca69 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.552428 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a611dcdf-4b23-4193-8881-1a3828f9ca69 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.552948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a611dcdf-4b23-4193-8881-1a3828f9ca69 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.553758 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a611dcdf-4b23-4193-8881-1a3828f9ca69 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.554214 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a611dcdf-4b23-4193-8881-1a3828f9ca69 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.554638 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a611dcdf-4b23-4193-8881-1a3828f9ca69 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.675399 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a611dcdf-4b23-4193-8881-1a3828f9ca69 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:15.683377 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:15.696037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a611dcdf-4b23-4193-8881-1a3828f9ca69 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1310 microversion: 2.1 time: 0.167767 Oct 27 09:39:15.697029 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:15.698530 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:15.699328 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 200/403] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:15 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1310 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:15.705548 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a540d2ca-ec1c-4090-9b5a-fc1855f9617b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.282088 Oct 27 09:39:15.706386 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 204/404] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:15 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:15.707016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-01930fe4-0463-412e-96f6-ad3203836c2f req-ff0ef956-0e3e-418c-bbb0-eaa86f4751de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2612979-fbed-42ac-b725-265018416862", "tag": "3a528390-aec1-4a57-8443-f4bdcd15f187"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:15.717349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-01930fe4-0463-412e-96f6-ad3203836c2f req-ff0ef956-0e3e-418c-bbb0-eaa86f4751de service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:15.718102 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-01930fe4-0463-412e-96f6-ad3203836c2f req-ff0ef956-0e3e-418c-bbb0-eaa86f4751de service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:15.718701 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-01930fe4-0463-412e-96f6-ad3203836c2f req-ff0ef956-0e3e-418c-bbb0-eaa86f4751de service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:15.731736 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-01930fe4-0463-412e-96f6-ad3203836c2f req-ff0ef956-0e3e-418c-bbb0-eaa86f4751de service nova] Creating event network-changed:3a528390-aec1-4a57-8443-f4bdcd15f187 for instance d2612979-fbed-42ac-b725-265018416862 on hv-cinder-79797 Oct 27 09:39:15.736863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-01930fe4-0463-412e-96f6-ad3203836c2f req-ff0ef956-0e3e-418c-bbb0-eaa86f4751de service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036237 Oct 27 09:39:15.737634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 201/405] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:16.104599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e69273a9-d7c2-4750-a9ba-1506e3cb25d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:16.105209 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e69273a9-d7c2-4750-a9ba-1506e3cb25d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:16.111147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e69273a9-d7c2-4750-a9ba-1506e3cb25d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:16.111625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e69273a9-d7c2-4750-a9ba-1506e3cb25d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:16.112056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e69273a9-d7c2-4750-a9ba-1506e3cb25d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:16.112763 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e69273a9-d7c2-4750-a9ba-1506e3cb25d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:16.113216 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e69273a9-d7c2-4750-a9ba-1506e3cb25d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:16.113638 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e69273a9-d7c2-4750-a9ba-1506e3cb25d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:16.240948 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e69273a9-d7c2-4750-a9ba-1506e3cb25d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:16.248588 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e69273a9-d7c2-4750-a9ba-1506e3cb25d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.147831 Oct 27 09:39:16.249157 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 205/406] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:16 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:16.364081 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ec577006-8c35-4ac2-9360-239e5aa8a23c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:16.364800 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ec577006-8c35-4ac2-9360-239e5aa8a23c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:16.370802 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec577006-8c35-4ac2-9360-239e5aa8a23c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:16.371278 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec577006-8c35-4ac2-9360-239e5aa8a23c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:16.371708 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec577006-8c35-4ac2-9360-239e5aa8a23c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:16.372396 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec577006-8c35-4ac2-9360-239e5aa8a23c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:16.372869 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec577006-8c35-4ac2-9360-239e5aa8a23c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:16.373281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec577006-8c35-4ac2-9360-239e5aa8a23c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:16.506749 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ec577006-8c35-4ac2-9360-239e5aa8a23c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:16.514390 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ec577006-8c35-4ac2-9360-239e5aa8a23c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.154889 Oct 27 09:39:16.514947 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 202/407] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:16 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:16.721702 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-69001126-ee70-4820-af0b-0dad66c85fa1 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:16.722237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-69001126-ee70-4820-af0b-0dad66c85fa1 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:16.728135 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-69001126-ee70-4820-af0b-0dad66c85fa1 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:16.728713 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-69001126-ee70-4820-af0b-0dad66c85fa1 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:16.729650 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-69001126-ee70-4820-af0b-0dad66c85fa1 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:16.730332 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-69001126-ee70-4820-af0b-0dad66c85fa1 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:16.730780 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-69001126-ee70-4820-af0b-0dad66c85fa1 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:16.731200 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-69001126-ee70-4820-af0b-0dad66c85fa1 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:16.732499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:16.733155 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:16.739190 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:16.739703 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:16.740138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:16.740858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:16.741313 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:16.741733 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:16.802612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-69001126-ee70-4820-af0b-0dad66c85fa1 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:16.810771 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-69001126-ee70-4820-af0b-0dad66c85fa1 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1310 microversion: 2.1 time: 0.093012 Oct 27 09:39:16.811335 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 206/408] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:16 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:16.886177 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:16.894280 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:16.895728 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:16.896902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-29eccd41-4a98-4e2f-98d8-28234041e288 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.168754 Oct 27 09:39:16.897465 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 203/409] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:16 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:39:17.271364 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-15201cd6-2d44-42df-8e4b-0cb7929438fc tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:17.271984 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-15201cd6-2d44-42df-8e4b-0cb7929438fc tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:17.277975 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15201cd6-2d44-42df-8e4b-0cb7929438fc tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:17.278458 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15201cd6-2d44-42df-8e4b-0cb7929438fc tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:17.278901 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15201cd6-2d44-42df-8e4b-0cb7929438fc tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:17.279602 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15201cd6-2d44-42df-8e4b-0cb7929438fc tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:17.280057 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15201cd6-2d44-42df-8e4b-0cb7929438fc tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:17.280485 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-15201cd6-2d44-42df-8e4b-0cb7929438fc tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:17.412204 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-15201cd6-2d44-42df-8e4b-0cb7929438fc tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:17.420537 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-15201cd6-2d44-42df-8e4b-0cb7929438fc tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.153283 Oct 27 09:39:17.421245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 207/410] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:17 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:17.536819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d50c1c46-be99-4c09-8062-3d164f763a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:17.537360 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d50c1c46-be99-4c09-8062-3d164f763a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:17.544002 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d50c1c46-be99-4c09-8062-3d164f763a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:17.544482 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d50c1c46-be99-4c09-8062-3d164f763a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:17.544939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d50c1c46-be99-4c09-8062-3d164f763a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:17.545624 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d50c1c46-be99-4c09-8062-3d164f763a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:17.546079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d50c1c46-be99-4c09-8062-3d164f763a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:17.546502 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d50c1c46-be99-4c09-8062-3d164f763a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:17.673010 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d50c1c46-be99-4c09-8062-3d164f763a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:17.680736 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d50c1c46-be99-4c09-8062-3d164f763a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.147750 Oct 27 09:39:17.681511 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 204/411] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:17 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:17.833260 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8a7dae28-71d0-459d-a09e-3996d1a8a87b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:17.833868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8a7dae28-71d0-459d-a09e-3996d1a8a87b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:17.840342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a7dae28-71d0-459d-a09e-3996d1a8a87b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:17.840849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a7dae28-71d0-459d-a09e-3996d1a8a87b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:17.841276 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a7dae28-71d0-459d-a09e-3996d1a8a87b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:17.841948 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a7dae28-71d0-459d-a09e-3996d1a8a87b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:17.842389 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a7dae28-71d0-459d-a09e-3996d1a8a87b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:17.842800 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8a7dae28-71d0-459d-a09e-3996d1a8a87b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:17.902231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-8a7dae28-71d0-459d-a09e-3996d1a8a87b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:17.909600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8a7dae28-71d0-459d-a09e-3996d1a8a87b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1318 microversion: 2.1 time: 0.080206 Oct 27 09:39:17.910160 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 208/412] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:17 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1318 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:17.921807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:17.922421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:17.928836 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:17.929318 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:17.929758 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:17.930467 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:17.930905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:17.931326 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:18.061566 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:18.069731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:18.071172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:18.072345 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-bda1e106-2e19-49a9-b6e6-0d8e4d9a7b70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1739 microversion: 2.20 time: 0.154398 Oct 27 09:39:18.073434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 205/413] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:17 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:18.429694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-fd5fdd6a-a3c3-42d1-be87-e834a74a99cd req-02767bf9-f61e-48bc-a07e-a2d79d9b4171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596c5c1c-3555-40e9-a2d3-6c6300478846", "name": "network-vif-plugged", "status": "completed", "tag": "af533890-8a09-4e93-ac93-881cbb38ca23"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:18.443277 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-35b836a3-f752-48f2-b972-05dd795929ba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:18.443997 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-35b836a3-f752-48f2-b972-05dd795929ba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:18.445434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-fd5fdd6a-a3c3-42d1-be87-e834a74a99cd req-02767bf9-f61e-48bc-a07e-a2d79d9b4171 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:18.446010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-fd5fdd6a-a3c3-42d1-be87-e834a74a99cd req-02767bf9-f61e-48bc-a07e-a2d79d9b4171 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:18.446639 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-fd5fdd6a-a3c3-42d1-be87-e834a74a99cd req-02767bf9-f61e-48bc-a07e-a2d79d9b4171 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:18.455739 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:18.458328 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35b836a3-f752-48f2-b972-05dd795929ba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:18.460641 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35b836a3-f752-48f2-b972-05dd795929ba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:18.461338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35b836a3-f752-48f2-b972-05dd795929ba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:18.463719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35b836a3-f752-48f2-b972-05dd795929ba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:18.466324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35b836a3-f752-48f2-b972-05dd795929ba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:18.467004 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35b836a3-f752-48f2-b972-05dd795929ba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:18.478989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-fd5fdd6a-a3c3-42d1-be87-e834a74a99cd req-02767bf9-f61e-48bc-a07e-a2d79d9b4171 service nova] Creating event network-vif-plugged:af533890-8a09-4e93-ac93-881cbb38ca23 for instance 596c5c1c-3555-40e9-a2d3-6c6300478846 on hv-cinder-79797 Oct 27 09:39:18.485021 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-fd5fdd6a-a3c3-42d1-be87-e834a74a99cd req-02767bf9-f61e-48bc-a07e-a2d79d9b4171 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059269 Oct 27 09:39:18.490125 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 209/414] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:18.658903 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-35b836a3-f752-48f2-b972-05dd795929ba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:18.669315 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-35b836a3-f752-48f2-b972-05dd795929ba tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.230227 Oct 27 09:39:18.670340 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 206/415] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:18 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:18.704342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-39d878c7-4a35-4364-bdd9-4514b81233c2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:18.705084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-39d878c7-4a35-4364-bdd9-4514b81233c2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:18.711324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-39d878c7-4a35-4364-bdd9-4514b81233c2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:18.711859 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-39d878c7-4a35-4364-bdd9-4514b81233c2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:18.712577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-39d878c7-4a35-4364-bdd9-4514b81233c2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:18.713556 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-39d878c7-4a35-4364-bdd9-4514b81233c2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:18.714007 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-39d878c7-4a35-4364-bdd9-4514b81233c2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:18.714699 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-39d878c7-4a35-4364-bdd9-4514b81233c2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:18.719672 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:18.852770 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-39d878c7-4a35-4364-bdd9-4514b81233c2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:18.860535 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-39d878c7-4a35-4364-bdd9-4514b81233c2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.160968 Oct 27 09:39:18.861104 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 210/416] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:18 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:18.933738 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ca39784b-e34f-46ca-bb8f-59e378ab3394 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:18.934642 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ca39784b-e34f-46ca-bb8f-59e378ab3394 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:18.942013 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca39784b-e34f-46ca-bb8f-59e378ab3394 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:18.942507 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca39784b-e34f-46ca-bb8f-59e378ab3394 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:18.942942 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca39784b-e34f-46ca-bb8f-59e378ab3394 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:18.943760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca39784b-e34f-46ca-bb8f-59e378ab3394 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:18.944228 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca39784b-e34f-46ca-bb8f-59e378ab3394 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:18.944680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca39784b-e34f-46ca-bb8f-59e378ab3394 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:19.098658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:19.099575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:19.110731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:19.111243 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:19.111689 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:19.115608 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:19.117093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:19.117712 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:19.180131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ca39784b-e34f-46ca-bb8f-59e378ab3394 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:19.189310 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ca39784b-e34f-46ca-bb8f-59e378ab3394 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.260726 Oct 27 09:39:19.195212 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 207/417] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:18 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:19.452728 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:19.461699 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:19.474411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:19.475869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a1d4b0b2-ee8d-4a3b-b317-b04286df1ec2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.381607 Oct 27 09:39:19.489106 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 211/418] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:19 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:39:19.693150 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-07e3b11a-9b2b-4deb-b27e-5ed645cbf165 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:19.693760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-07e3b11a-9b2b-4deb-b27e-5ed645cbf165 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:19.703713 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-07e3b11a-9b2b-4deb-b27e-5ed645cbf165 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:19.704837 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-07e3b11a-9b2b-4deb-b27e-5ed645cbf165 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:19.706026 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-07e3b11a-9b2b-4deb-b27e-5ed645cbf165 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:19.707010 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-07e3b11a-9b2b-4deb-b27e-5ed645cbf165 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:19.707768 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-07e3b11a-9b2b-4deb-b27e-5ed645cbf165 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:19.708271 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-07e3b11a-9b2b-4deb-b27e-5ed645cbf165 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:19.883578 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3746eb00-233d-4d8c-abc8-ec247ce26d6a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:19.886171 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3746eb00-233d-4d8c-abc8-ec247ce26d6a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:19.888597 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-07e3b11a-9b2b-4deb-b27e-5ed645cbf165 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:19.893961 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:19.896239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=20 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:19.898614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-07e3b11a-9b2b-4deb-b27e-5ed645cbf165 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.209475 Oct 27 09:39:19.899661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 208/419] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:19 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:19.900532 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3746eb00-233d-4d8c-abc8-ec247ce26d6a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:19.901634 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3746eb00-233d-4d8c-abc8-ec247ce26d6a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:19.902188 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3746eb00-233d-4d8c-abc8-ec247ce26d6a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:19.903206 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3746eb00-233d-4d8c-abc8-ec247ce26d6a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:19.903917 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3746eb00-233d-4d8c-abc8-ec247ce26d6a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:19.904631 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3746eb00-233d-4d8c-abc8-ec247ce26d6a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:20.069397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3746eb00-233d-4d8c-abc8-ec247ce26d6a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:20.077761 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3746eb00-233d-4d8c-abc8-ec247ce26d6a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.198324 Oct 27 09:39:20.078801 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 212/420] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:19 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:20.156217 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-a8f75aec-c1c0-4900-b265-777d30fe5987 req-a07a2cac-0c1f-4a98-ac3a-6ea29d6f420a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc27f94-5b44-482f-9d13-b102e27b7a10", "tag": "7969c643-a189-494b-ab3e-877a44420350"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:20.162715 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=10 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:20.176362 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a8f75aec-c1c0-4900-b265-777d30fe5987 req-a07a2cac-0c1f-4a98-ac3a-6ea29d6f420a service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:20.176880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a8f75aec-c1c0-4900-b265-777d30fe5987 req-a07a2cac-0c1f-4a98-ac3a-6ea29d6f420a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:20.177307 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a8f75aec-c1c0-4900-b265-777d30fe5987 req-a07a2cac-0c1f-4a98-ac3a-6ea29d6f420a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:20.201249 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-a8f75aec-c1c0-4900-b265-777d30fe5987 req-a07a2cac-0c1f-4a98-ac3a-6ea29d6f420a service nova] Creating event network-changed:7969c643-a189-494b-ab3e-877a44420350 for instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 on hv-cinder-79797 Oct 27 09:39:20.207023 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-a8f75aec-c1c0-4900-b265-777d30fe5987 req-a07a2cac-0c1f-4a98-ac3a-6ea29d6f420a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054571 Oct 27 09:39:20.207650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 209/421] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:20.218116 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-09836717-bd6d-4654-b8f4-2ac84979f5f5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:20.218732 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-09836717-bd6d-4654-b8f4-2ac84979f5f5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:20.224848 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09836717-bd6d-4654-b8f4-2ac84979f5f5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:20.225326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09836717-bd6d-4654-b8f4-2ac84979f5f5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:20.226467 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09836717-bd6d-4654-b8f4-2ac84979f5f5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:20.227168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09836717-bd6d-4654-b8f4-2ac84979f5f5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:20.227623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09836717-bd6d-4654-b8f4-2ac84979f5f5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:20.228043 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09836717-bd6d-4654-b8f4-2ac84979f5f5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:20.382563 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-09836717-bd6d-4654-b8f4-2ac84979f5f5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:20.392617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-09836717-bd6d-4654-b8f4-2ac84979f5f5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.178224 Oct 27 09:39:20.393426 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 213/422] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:20 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:20.506020 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:20.506716 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:20.513362 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:20.513849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:20.514276 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:20.514977 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:20.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:20.516022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:20.692661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:20.701612 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:20.703048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:20.704482 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-54530238-b89b-4a70-97d4-f06210d75f73 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.202825 Oct 27 09:39:20.705046 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 210/423] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:20 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:20.927224 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b7df07fa-2b79-49b5-a668-ec10c4977e34 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:20.927910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b7df07fa-2b79-49b5-a668-ec10c4977e34 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:20.942247 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7df07fa-2b79-49b5-a668-ec10c4977e34 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:20.942743 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7df07fa-2b79-49b5-a668-ec10c4977e34 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:20.943176 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7df07fa-2b79-49b5-a668-ec10c4977e34 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:20.943882 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7df07fa-2b79-49b5-a668-ec10c4977e34 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:20.944336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7df07fa-2b79-49b5-a668-ec10c4977e34 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:20.944787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b7df07fa-2b79-49b5-a668-ec10c4977e34 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:21.082947 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b7df07fa-2b79-49b5-a668-ec10c4977e34 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:21.091013 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b7df07fa-2b79-49b5-a668-ec10c4977e34 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.167677 Oct 27 09:39:21.091585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 214/424] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:20 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:21.103871 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-849ddae9-3a3d-446c-bac7-236d6e73f01a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:21.104689 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-849ddae9-3a3d-446c-bac7-236d6e73f01a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:21.112204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849ddae9-3a3d-446c-bac7-236d6e73f01a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:21.112724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849ddae9-3a3d-446c-bac7-236d6e73f01a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:21.113158 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849ddae9-3a3d-446c-bac7-236d6e73f01a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:21.113853 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849ddae9-3a3d-446c-bac7-236d6e73f01a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:21.114302 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849ddae9-3a3d-446c-bac7-236d6e73f01a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:21.115008 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849ddae9-3a3d-446c-bac7-236d6e73f01a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:21.253003 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-849ddae9-3a3d-446c-bac7-236d6e73f01a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:21.261964 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-849ddae9-3a3d-446c-bac7-236d6e73f01a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.162341 Oct 27 09:39:21.262536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 211/425] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:21 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:21.417228 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cd5e8af0-d319-45e4-9064-18ac3f495b06 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:21.418139 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cd5e8af0-d319-45e4-9064-18ac3f495b06 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:21.424542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd5e8af0-d319-45e4-9064-18ac3f495b06 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:21.425041 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd5e8af0-d319-45e4-9064-18ac3f495b06 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:21.425473 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd5e8af0-d319-45e4-9064-18ac3f495b06 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:21.426283 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd5e8af0-d319-45e4-9064-18ac3f495b06 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:21.426753 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd5e8af0-d319-45e4-9064-18ac3f495b06 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:21.427450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd5e8af0-d319-45e4-9064-18ac3f495b06 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:21.593296 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cd5e8af0-d319-45e4-9064-18ac3f495b06 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:21.601143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cd5e8af0-d319-45e4-9064-18ac3f495b06 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.189463 Oct 27 09:39:21.601722 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 215/426] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:21 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:21.731487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:21.732193 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:21.738608 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:21.739181 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:21.739684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:21.740473 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:21.741195 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:21.741781 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:21.768827 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:21.892920 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:21.902362 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:21.903903 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:21.905133 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c4dcae3c-a9c0-4344-ad14-c5e6f83b674f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.178078 Oct 27 09:39:21.905699 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 212/427] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:21 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:22.116550 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e42f5988-0187-49b9-a91e-0fe05709ed5a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:22.118246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e42f5988-0187-49b9-a91e-0fe05709ed5a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:22.124729 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e42f5988-0187-49b9-a91e-0fe05709ed5a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:22.125219 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e42f5988-0187-49b9-a91e-0fe05709ed5a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:22.125656 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e42f5988-0187-49b9-a91e-0fe05709ed5a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:22.126970 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e42f5988-0187-49b9-a91e-0fe05709ed5a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:22.127447 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e42f5988-0187-49b9-a91e-0fe05709ed5a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:22.127874 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e42f5988-0187-49b9-a91e-0fe05709ed5a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:22.265545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e42f5988-0187-49b9-a91e-0fe05709ed5a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:22.284719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-44a4f424-4809-4971-bdc9-bbbe9d419b0e tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:22.285680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-44a4f424-4809-4971-bdc9-bbbe9d419b0e tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:22.291731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e42f5988-0187-49b9-a91e-0fe05709ed5a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.179286 Oct 27 09:39:22.293143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 216/428] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:22 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:22.293501 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-44a4f424-4809-4971-bdc9-bbbe9d419b0e tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:22.293992 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-44a4f424-4809-4971-bdc9-bbbe9d419b0e tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:22.294430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-44a4f424-4809-4971-bdc9-bbbe9d419b0e tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:22.295133 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-44a4f424-4809-4971-bdc9-bbbe9d419b0e tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:22.295621 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-44a4f424-4809-4971-bdc9-bbbe9d419b0e tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:22.296219 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-44a4f424-4809-4971-bdc9-bbbe9d419b0e tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:22.443700 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-44a4f424-4809-4971-bdc9-bbbe9d419b0e tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:22.453474 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-44a4f424-4809-4971-bdc9-bbbe9d419b0e tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.172280 Oct 27 09:39:22.460584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 213/429] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:22 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:22.623459 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-896306e6-30f8-46e8-ba6b-67ee705fabc7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:22.624076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-896306e6-30f8-46e8-ba6b-67ee705fabc7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:22.625987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:22.631950 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-896306e6-30f8-46e8-ba6b-67ee705fabc7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:22.632441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-896306e6-30f8-46e8-ba6b-67ee705fabc7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:22.632929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-896306e6-30f8-46e8-ba6b-67ee705fabc7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:22.633629 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-896306e6-30f8-46e8-ba6b-67ee705fabc7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:22.634085 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-896306e6-30f8-46e8-ba6b-67ee705fabc7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:22.634510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-896306e6-30f8-46e8-ba6b-67ee705fabc7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:22.772101 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-896306e6-30f8-46e8-ba6b-67ee705fabc7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:22.779717 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-896306e6-30f8-46e8-ba6b-67ee705fabc7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.160054 Oct 27 09:39:22.780271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 217/430] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:22 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:22.931428 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:22.931977 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:22.937941 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:22.938417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:22.938848 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:22.939532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:22.939984 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:22.940406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:23.069500 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:23.079156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:23.080921 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:23.082180 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-65a3cb61-aeb7-4a51-a7d3-8bb980d28532 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.154856 Oct 27 09:39:23.082733 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 214/431] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:22 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:23.316947 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4ad0337b-d8a5-4018-bb38-91c16b0230d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:23.317588 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4ad0337b-d8a5-4018-bb38-91c16b0230d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:23.324049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4ad0337b-d8a5-4018-bb38-91c16b0230d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:23.324900 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4ad0337b-d8a5-4018-bb38-91c16b0230d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:23.325033 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4ad0337b-d8a5-4018-bb38-91c16b0230d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:23.325669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4ad0337b-d8a5-4018-bb38-91c16b0230d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:23.326165 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4ad0337b-d8a5-4018-bb38-91c16b0230d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:23.326590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4ad0337b-d8a5-4018-bb38-91c16b0230d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:23.469151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4ad0337b-d8a5-4018-bb38-91c16b0230d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:23.476943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-80bea870-8d3a-4a9a-86a5-f5f5b04c0a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:23.477153 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4ad0337b-d8a5-4018-bb38-91c16b0230d1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.163989 Oct 27 09:39:23.477627 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 218/432] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:23 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:23.477778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-80bea870-8d3a-4a9a-86a5-f5f5b04c0a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:23.484419 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80bea870-8d3a-4a9a-86a5-f5f5b04c0a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:23.484958 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80bea870-8d3a-4a9a-86a5-f5f5b04c0a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:23.485448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80bea870-8d3a-4a9a-86a5-f5f5b04c0a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:23.486143 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80bea870-8d3a-4a9a-86a5-f5f5b04c0a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:23.486601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80bea870-8d3a-4a9a-86a5-f5f5b04c0a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:23.487025 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80bea870-8d3a-4a9a-86a5-f5f5b04c0a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:23.629460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-80bea870-8d3a-4a9a-86a5-f5f5b04c0a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:23.637465 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-80bea870-8d3a-4a9a-86a5-f5f5b04c0a80 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.164313 Oct 27 09:39:23.638255 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 215/433] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:23 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:23.803588 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-392b2aaa-7222-4a82-93ae-43ed7d202236 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:23.804792 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-392b2aaa-7222-4a82-93ae-43ed7d202236 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:23.813312 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-392b2aaa-7222-4a82-93ae-43ed7d202236 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:23.814205 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-392b2aaa-7222-4a82-93ae-43ed7d202236 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:23.814736 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-392b2aaa-7222-4a82-93ae-43ed7d202236 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:23.815473 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-392b2aaa-7222-4a82-93ae-43ed7d202236 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:23.815951 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-392b2aaa-7222-4a82-93ae-43ed7d202236 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:23.816373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-392b2aaa-7222-4a82-93ae-43ed7d202236 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:23.968641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-392b2aaa-7222-4a82-93ae-43ed7d202236 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:23.976487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-392b2aaa-7222-4a82-93ae-43ed7d202236 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.178341 Oct 27 09:39:23.977074 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 219/434] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:23 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:24.108234 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:24.108879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:24.114743 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:24.115227 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:24.115661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:24.116359 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:24.116867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:24.117290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:24.141052 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-80eca919-6413-4f7b-a74d-9b5dd92622d4 req-2d4a8bdd-a278-418b-ad45-414748c44dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac6a130-38c4-4843-b9a8-118d25c11c18", "name": "network-vif-unplugged", "status": "completed", "tag": "0e6b0478-48aa-4f67-86d8-eb4b392e3971"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:24.158115 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-80eca919-6413-4f7b-a74d-9b5dd92622d4 req-2d4a8bdd-a278-418b-ad45-414748c44dd0 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:24.159213 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-80eca919-6413-4f7b-a74d-9b5dd92622d4 req-2d4a8bdd-a278-418b-ad45-414748c44dd0 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:24.159947 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-80eca919-6413-4f7b-a74d-9b5dd92622d4 req-2d4a8bdd-a278-418b-ad45-414748c44dd0 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:24.183767 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-80eca919-6413-4f7b-a74d-9b5dd92622d4 req-2d4a8bdd-a278-418b-ad45-414748c44dd0 service nova] Creating event network-vif-unplugged:0e6b0478-48aa-4f67-86d8-eb4b392e3971 for instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 on hv-cinder-79797 Oct 27 09:39:24.200761 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-80eca919-6413-4f7b-a74d-9b5dd92622d4 req-2d4a8bdd-a278-418b-ad45-414748c44dd0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057011 Oct 27 09:39:24.201750 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 220/435] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:39:24.288648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:24.311348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:24.313099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:24.314340 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-92b5356c-5a3d-436c-9f34-ad99c9b4cb67 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.210900 Oct 27 09:39:24.314980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 216/436] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:24 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:24.499961 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-dfe8dbd5-5740-4d19-9849-73ab51870ec7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:24.500694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-dfe8dbd5-5740-4d19-9849-73ab51870ec7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:24.506960 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dfe8dbd5-5740-4d19-9849-73ab51870ec7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:24.507444 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dfe8dbd5-5740-4d19-9849-73ab51870ec7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:24.507872 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dfe8dbd5-5740-4d19-9849-73ab51870ec7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:24.508590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dfe8dbd5-5740-4d19-9849-73ab51870ec7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:24.509062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dfe8dbd5-5740-4d19-9849-73ab51870ec7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:24.509989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dfe8dbd5-5740-4d19-9849-73ab51870ec7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:24.643315 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-dfe8dbd5-5740-4d19-9849-73ab51870ec7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:24.652247 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-dfe8dbd5-5740-4d19-9849-73ab51870ec7 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.156404 Oct 27 09:39:24.654637 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 221/437] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:24 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:24.662147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-57e2943c-fcbd-4b2a-924c-7a1d79f42255 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:24.662765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-57e2943c-fcbd-4b2a-924c-7a1d79f42255 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:24.669959 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e2943c-fcbd-4b2a-924c-7a1d79f42255 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:24.670448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e2943c-fcbd-4b2a-924c-7a1d79f42255 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:24.670883 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e2943c-fcbd-4b2a-924c-7a1d79f42255 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:24.671573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e2943c-fcbd-4b2a-924c-7a1d79f42255 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:24.672034 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e2943c-fcbd-4b2a-924c-7a1d79f42255 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:24.672456 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e2943c-fcbd-4b2a-924c-7a1d79f42255 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:24.812617 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-57e2943c-fcbd-4b2a-924c-7a1d79f42255 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:24.821893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-57e2943c-fcbd-4b2a-924c-7a1d79f42255 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.163539 Oct 27 09:39:24.823320 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 217/438] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:24 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:25.000145 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ad09f6a6-a376-4264-aaf2-e3d04df36ae0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:25.000781 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ad09f6a6-a376-4264-aaf2-e3d04df36ae0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:25.006758 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad09f6a6-a376-4264-aaf2-e3d04df36ae0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:25.007187 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad09f6a6-a376-4264-aaf2-e3d04df36ae0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:25.007622 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad09f6a6-a376-4264-aaf2-e3d04df36ae0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:25.008307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad09f6a6-a376-4264-aaf2-e3d04df36ae0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:25.008792 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad09f6a6-a376-4264-aaf2-e3d04df36ae0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:25.009219 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ad09f6a6-a376-4264-aaf2-e3d04df36ae0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:25.172323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ad09f6a6-a376-4264-aaf2-e3d04df36ae0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:25.180207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ad09f6a6-a376-4264-aaf2-e3d04df36ae0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.183872 Oct 27 09:39:25.181153 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 222/439] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:24 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:25.340452 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:25.341147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:25.347602 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:25.348094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:25.348559 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:25.349276 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:25.357285 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:25.357741 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:25.675212 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3de02485-ddb0-4786-b3da-a52c7469b191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:25.676663 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3de02485-ddb0-4786-b3da-a52c7469b191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:25.684714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3de02485-ddb0-4786-b3da-a52c7469b191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:25.685563 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3de02485-ddb0-4786-b3da-a52c7469b191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:25.686456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3de02485-ddb0-4786-b3da-a52c7469b191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:25.687412 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3de02485-ddb0-4786-b3da-a52c7469b191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:25.688094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3de02485-ddb0-4786-b3da-a52c7469b191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:25.688770 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3de02485-ddb0-4786-b3da-a52c7469b191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:25.722772 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:25.731627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:25.733365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:25.734745 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-91e5efac-8549-4e68-b64a-63d3fec1c945 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.399108 Oct 27 09:39:25.735791 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 218/440] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:25 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:25.831236 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3de02485-ddb0-4786-b3da-a52c7469b191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:25.840959 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3de02485-ddb0-4786-b3da-a52c7469b191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.169464 Oct 27 09:39:25.849361 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 223/441] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:25 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:25.850522 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f1796050-0a74-41f2-b052-b884cf674c3c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:25.851203 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f1796050-0a74-41f2-b052-b884cf674c3c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:25.857936 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1796050-0a74-41f2-b052-b884cf674c3c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:25.858430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1796050-0a74-41f2-b052-b884cf674c3c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:25.858867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1796050-0a74-41f2-b052-b884cf674c3c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:25.859566 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1796050-0a74-41f2-b052-b884cf674c3c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:25.860021 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1796050-0a74-41f2-b052-b884cf674c3c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:25.860445 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1796050-0a74-41f2-b052-b884cf674c3c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:26.005978 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f1796050-0a74-41f2-b052-b884cf674c3c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:26.015054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f1796050-0a74-41f2-b052-b884cf674c3c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.168335 Oct 27 09:39:26.016324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 219/442] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:25 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:26.206200 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f7e226f2-d693-42ce-86df-7fb65f79d598 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:26.206888 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f7e226f2-d693-42ce-86df-7fb65f79d598 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:26.213782 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7e226f2-d693-42ce-86df-7fb65f79d598 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:26.214344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7e226f2-d693-42ce-86df-7fb65f79d598 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:26.214850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7e226f2-d693-42ce-86df-7fb65f79d598 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:26.215739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7e226f2-d693-42ce-86df-7fb65f79d598 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:26.216356 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7e226f2-d693-42ce-86df-7fb65f79d598 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:26.217000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7e226f2-d693-42ce-86df-7fb65f79d598 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:26.358940 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f7e226f2-d693-42ce-86df-7fb65f79d598 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:26.366811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f7e226f2-d693-42ce-86df-7fb65f79d598 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.164803 Oct 27 09:39:26.367577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 224/443] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:26 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:26.763429 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:26.764444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:26.766074 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:26.776132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:26.777273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:26.778163 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:26.779650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:26.780706 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:26.781677 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:26.864613 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-efb23218-d7c9-455a-bf5b-8db07ae79efe tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:26.865223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-efb23218-d7c9-455a-bf5b-8db07ae79efe tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:26.876109 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efb23218-d7c9-455a-bf5b-8db07ae79efe tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:26.876578 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efb23218-d7c9-455a-bf5b-8db07ae79efe tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:26.877010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efb23218-d7c9-455a-bf5b-8db07ae79efe tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:26.877709 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efb23218-d7c9-455a-bf5b-8db07ae79efe tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:26.878155 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efb23218-d7c9-455a-bf5b-8db07ae79efe tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:26.878584 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-efb23218-d7c9-455a-bf5b-8db07ae79efe tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:26.983253 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:27.002457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:27.004090 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:27.005933 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1881b084-c1a9-4183-8484-fc81c23ba6a9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.248410 Oct 27 09:39:27.012436 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 220/444] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:26 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:27.029942 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-efb23218-d7c9-455a-bf5b-8db07ae79efe tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:27.040653 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f1b22a41-880e-48b1-ba68-f598aae1a863 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:27.041297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f1b22a41-880e-48b1-ba68-f598aae1a863 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:27.041829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-efb23218-d7c9-455a-bf5b-8db07ae79efe tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.180922 Oct 27 09:39:27.043011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 225/445] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:26 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:27.063102 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1b22a41-880e-48b1-ba68-f598aae1a863 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:27.063644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1b22a41-880e-48b1-ba68-f598aae1a863 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:27.064027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1b22a41-880e-48b1-ba68-f598aae1a863 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:27.064766 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1b22a41-880e-48b1-ba68-f598aae1a863 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:27.065210 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1b22a41-880e-48b1-ba68-f598aae1a863 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:27.065633 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1b22a41-880e-48b1-ba68-f598aae1a863 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:27.113176 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e3c52be1-0e3e-4636-9cb1-813b8a930aa6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:27.114817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e3c52be1-0e3e-4636-9cb1-813b8a930aa6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:27.122895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e3c52be1-0e3e-4636-9cb1-813b8a930aa6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:27.124343 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e3c52be1-0e3e-4636-9cb1-813b8a930aa6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:27.124953 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e3c52be1-0e3e-4636-9cb1-813b8a930aa6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:27.125881 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e3c52be1-0e3e-4636-9cb1-813b8a930aa6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:27.126599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e3c52be1-0e3e-4636-9cb1-813b8a930aa6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:27.127113 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e3c52be1-0e3e-4636-9cb1-813b8a930aa6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:27.216036 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f1b22a41-880e-48b1-ba68-f598aae1a863 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:27.224365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f1b22a41-880e-48b1-ba68-f598aae1a863 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.187759 Oct 27 09:39:27.225048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 221/446] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:27 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:27.269307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-e3c52be1-0e3e-4636-9cb1-813b8a930aa6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lazy-loading 'services' on Instance uuid acba3b76-8223-4305-80d8-e739b12c6fcf {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:39:27.377559 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:27.389508 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e3c52be1-0e3e-4636-9cb1-813b8a930aa6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "DELETE /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf/os-volume_attachments/495e25c4-1096-49fc-aba7-ceaa5777afad" status: 202 len: 0 microversion: 2.1 time: 0.280404 Oct 27 09:39:27.390149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 226/447] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:39:27 2022] DELETE /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf/os-volume_attachments/495e25c4-1096-49fc-aba7-ceaa5777afad => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:39:27.393319 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ebd52d16-e9c1-4b4c-9040-317871177855 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:27.394064 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ebd52d16-e9c1-4b4c-9040-317871177855 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:27.400958 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ebd52d16-e9c1-4b4c-9040-317871177855 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:27.401499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ebd52d16-e9c1-4b4c-9040-317871177855 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:27.401942 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ebd52d16-e9c1-4b4c-9040-317871177855 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:27.402639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ebd52d16-e9c1-4b4c-9040-317871177855 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:27.403089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ebd52d16-e9c1-4b4c-9040-317871177855 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:27.403503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ebd52d16-e9c1-4b4c-9040-317871177855 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:27.576171 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ebd52d16-e9c1-4b4c-9040-317871177855 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:27.584125 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ebd52d16-e9c1-4b4c-9040-317871177855 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.197709 Oct 27 09:39:27.584829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 222/448] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:27 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:28.034066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:28.034976 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:28.042108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:28.042593 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:28.043023 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:28.043710 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:28.044300 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:28.044775 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:28.066102 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d6924441-db23-4797-bc52-effe96207a4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:28.066872 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d6924441-db23-4797-bc52-effe96207a4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:28.081038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6924441-db23-4797-bc52-effe96207a4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:28.084978 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6924441-db23-4797-bc52-effe96207a4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:28.085529 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6924441-db23-4797-bc52-effe96207a4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:28.086335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6924441-db23-4797-bc52-effe96207a4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:28.086857 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6924441-db23-4797-bc52-effe96207a4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:28.087342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6924441-db23-4797-bc52-effe96207a4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:28.251073 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:28.259938 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:28.261418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:28.262581 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cb37b71b-2872-409d-8203-9787d802b4b7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.234367 Oct 27 09:39:28.263143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 227/449] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:28 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:28.267625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-58676c7a-86e7-4c64-aceb-47fc488343ac tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:28.272591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-58676c7a-86e7-4c64-aceb-47fc488343ac tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:28.274180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58676c7a-86e7-4c64-aceb-47fc488343ac tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:28.274680 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58676c7a-86e7-4c64-aceb-47fc488343ac tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:28.275119 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58676c7a-86e7-4c64-aceb-47fc488343ac tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:28.275838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58676c7a-86e7-4c64-aceb-47fc488343ac tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:28.276271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58676c7a-86e7-4c64-aceb-47fc488343ac tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:28.276753 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58676c7a-86e7-4c64-aceb-47fc488343ac tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:28.293430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d6924441-db23-4797-bc52-effe96207a4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:28.305049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d6924441-db23-4797-bc52-effe96207a4a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.243272 Oct 27 09:39:28.306167 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 223/450] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:28 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:28.420753 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-58676c7a-86e7-4c64-aceb-47fc488343ac tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:28.429049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-58676c7a-86e7-4c64-aceb-47fc488343ac tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.164912 Oct 27 09:39:28.429640 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 228/451] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:28 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:28.606504 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b9cd4225-2b5f-4acc-a693-2c6e5b49b9e3 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:28.607121 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b9cd4225-2b5f-4acc-a693-2c6e5b49b9e3 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:28.613156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9cd4225-2b5f-4acc-a693-2c6e5b49b9e3 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:28.613641 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9cd4225-2b5f-4acc-a693-2c6e5b49b9e3 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:28.614073 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9cd4225-2b5f-4acc-a693-2c6e5b49b9e3 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:28.614763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9cd4225-2b5f-4acc-a693-2c6e5b49b9e3 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:28.615216 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9cd4225-2b5f-4acc-a693-2c6e5b49b9e3 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:28.615635 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9cd4225-2b5f-4acc-a693-2c6e5b49b9e3 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:28.746012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b9cd4225-2b5f-4acc-a693-2c6e5b49b9e3 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:28.754659 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b9cd4225-2b5f-4acc-a693-2c6e5b49b9e3 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.151657 Oct 27 09:39:28.755404 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 224/452] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:28 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:29.287977 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:29.288616 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:29.295115 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:29.295597 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:29.296015 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:29.296713 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:29.297158 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:29.297570 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:29.332241 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-69613a51-1299-4b46-af68-e34000934692 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:29.332875 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-69613a51-1299-4b46-af68-e34000934692 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:29.340128 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-69613a51-1299-4b46-af68-e34000934692 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:29.340646 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-69613a51-1299-4b46-af68-e34000934692 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:29.341084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-69613a51-1299-4b46-af68-e34000934692 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:29.341794 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-69613a51-1299-4b46-af68-e34000934692 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:29.342243 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-69613a51-1299-4b46-af68-e34000934692 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:29.342658 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-69613a51-1299-4b46-af68-e34000934692 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:29.490963 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:29.499367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:29.500823 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:29.501963 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ff1cf6fc-305c-42b9-8c6b-40964e4188d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.217827 Oct 27 09:39:29.502508 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 229/453] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:29 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:29.506774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-29a811c9-69c9-4906-8cde-e975bf692204 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:29.507371 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-29a811c9-69c9-4906-8cde-e975bf692204 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:29.515054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-69613a51-1299-4b46-af68-e34000934692 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:29.518739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29a811c9-69c9-4906-8cde-e975bf692204 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:29.519312 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29a811c9-69c9-4906-8cde-e975bf692204 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:29.519848 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29a811c9-69c9-4906-8cde-e975bf692204 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:29.520663 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29a811c9-69c9-4906-8cde-e975bf692204 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:29.521298 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29a811c9-69c9-4906-8cde-e975bf692204 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:29.521808 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29a811c9-69c9-4906-8cde-e975bf692204 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:29.522445 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-69613a51-1299-4b46-af68-e34000934692 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.194194 Oct 27 09:39:29.522998 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 225/454] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:29 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:29.656239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-29a811c9-69c9-4906-8cde-e975bf692204 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:29.663979 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-29a811c9-69c9-4906-8cde-e975bf692204 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.160507 Oct 27 09:39:29.664742 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 230/455] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:29 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:29.778457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a572218a-1d46-409e-a576-565527d9ff4b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:29.779067 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a572218a-1d46-409e-a576-565527d9ff4b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:29.784990 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a572218a-1d46-409e-a576-565527d9ff4b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:29.785456 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a572218a-1d46-409e-a576-565527d9ff4b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:29.785889 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a572218a-1d46-409e-a576-565527d9ff4b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:29.786573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a572218a-1d46-409e-a576-565527d9ff4b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:29.787018 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a572218a-1d46-409e-a576-565527d9ff4b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:29.787434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a572218a-1d46-409e-a576-565527d9ff4b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:29.911708 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a572218a-1d46-409e-a576-565527d9ff4b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:29.919165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a572218a-1d46-409e-a576-565527d9ff4b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.145197 Oct 27 09:39:29.919721 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 226/456] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:29 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:30.527999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:30.529459 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:30.537421 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:30.538604 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:30.539472 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:30.545220 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-84075ba2-1e61-42a5-9477-eda6674d68e1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:30.546615 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-84075ba2-1e61-42a5-9477-eda6674d68e1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:30.552504 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:30.553251 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:30.555314 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:30.561768 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84075ba2-1e61-42a5-9477-eda6674d68e1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:30.562263 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84075ba2-1e61-42a5-9477-eda6674d68e1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:30.562699 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84075ba2-1e61-42a5-9477-eda6674d68e1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:30.563419 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84075ba2-1e61-42a5-9477-eda6674d68e1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:30.563881 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84075ba2-1e61-42a5-9477-eda6674d68e1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:30.564305 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-84075ba2-1e61-42a5-9477-eda6674d68e1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:30.821171 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:30.828886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-84075ba2-1e61-42a5-9477-eda6674d68e1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:30.836695 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:30.838147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:30.839309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-91c53759-d516-41df-b7e3-4cf9b0ac88ac tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.315354 Oct 27 09:39:30.839876 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 231/457] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:30 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:30.844912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-84075ba2-1e61-42a5-9477-eda6674d68e1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.304041 Oct 27 09:39:30.845489 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 227/458] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:30 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:30.849434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7604b199-582f-4d68-855f-7c49ce6831de tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:30.850041 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7604b199-582f-4d68-855f-7c49ce6831de tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:30.855988 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7604b199-582f-4d68-855f-7c49ce6831de tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:30.857082 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7604b199-582f-4d68-855f-7c49ce6831de tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:30.857082 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7604b199-582f-4d68-855f-7c49ce6831de tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:30.857635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7604b199-582f-4d68-855f-7c49ce6831de tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:30.858089 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7604b199-582f-4d68-855f-7c49ce6831de tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:30.858516 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7604b199-582f-4d68-855f-7c49ce6831de tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:30.940981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c26cee4c-8c95-4d6f-bc21-ff32e625915f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:30.941591 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c26cee4c-8c95-4d6f-bc21-ff32e625915f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:30.947580 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c26cee4c-8c95-4d6f-bc21-ff32e625915f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:30.948736 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c26cee4c-8c95-4d6f-bc21-ff32e625915f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:30.949172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c26cee4c-8c95-4d6f-bc21-ff32e625915f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:30.949868 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c26cee4c-8c95-4d6f-bc21-ff32e625915f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:30.950324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c26cee4c-8c95-4d6f-bc21-ff32e625915f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:30.950746 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c26cee4c-8c95-4d6f-bc21-ff32e625915f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:31.006205 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7604b199-582f-4d68-855f-7c49ce6831de tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:31.013891 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7604b199-582f-4d68-855f-7c49ce6831de tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1260 microversion: 2.1 time: 0.173071 Oct 27 09:39:31.014457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 232/459] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:30 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:31.086938 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c26cee4c-8c95-4d6f-bc21-ff32e625915f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:31.095004 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c26cee4c-8c95-4d6f-bc21-ff32e625915f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.157870 Oct 27 09:39:31.095575 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 228/460] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:30 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:31.866475 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:31.867082 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:31.868092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-246ade45-29e2-418e-8278-b13005e768a6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:31.869109 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-246ade45-29e2-418e-8278-b13005e768a6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:31.875417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-246ade45-29e2-418e-8278-b13005e768a6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:31.876861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-246ade45-29e2-418e-8278-b13005e768a6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:31.877369 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-246ade45-29e2-418e-8278-b13005e768a6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:31.878295 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-246ade45-29e2-418e-8278-b13005e768a6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:31.878850 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-246ade45-29e2-418e-8278-b13005e768a6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:31.879344 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-246ade45-29e2-418e-8278-b13005e768a6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:31.880672 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:31.881157 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:31.881591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:31.882276 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:31.882932 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:31.883360 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:31.884864 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:32.085205 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-246ade45-29e2-418e-8278-b13005e768a6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:32.088846 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:32.093845 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-246ade45-29e2-418e-8278-b13005e768a6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.230023 Oct 27 09:39:32.094499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 229/461] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:31 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:32.097545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:32.098966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:32.099119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-65954e18-ab48-4e35-86c4-e7f13a683634 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:32.099880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-65954e18-ab48-4e35-86c4-e7f13a683634 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:32.100111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-bc91b0fc-865a-4c9c-929c-f455457127ad tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.237857 Oct 27 09:39:32.100674 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 233/462] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:31 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:32.105828 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65954e18-ab48-4e35-86c4-e7f13a683634 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:32.106312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65954e18-ab48-4e35-86c4-e7f13a683634 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:32.106740 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65954e18-ab48-4e35-86c4-e7f13a683634 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:32.107602 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65954e18-ab48-4e35-86c4-e7f13a683634 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:32.108218 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65954e18-ab48-4e35-86c4-e7f13a683634 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:32.108673 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65954e18-ab48-4e35-86c4-e7f13a683634 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:32.117404 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7d165f84-dd3c-404a-abec-d876dc6c5261 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:32.118011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7d165f84-dd3c-404a-abec-d876dc6c5261 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:32.123814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d165f84-dd3c-404a-abec-d876dc6c5261 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:32.124299 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d165f84-dd3c-404a-abec-d876dc6c5261 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:32.124771 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d165f84-dd3c-404a-abec-d876dc6c5261 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:32.125460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d165f84-dd3c-404a-abec-d876dc6c5261 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:32.125909 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d165f84-dd3c-404a-abec-d876dc6c5261 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:32.126329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d165f84-dd3c-404a-abec-d876dc6c5261 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:32.306161 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-65954e18-ab48-4e35-86c4-e7f13a683634 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:32.313241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7d165f84-dd3c-404a-abec-d876dc6c5261 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:32.313958 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-65954e18-ab48-4e35-86c4-e7f13a683634 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1443 microversion: 2.1 time: 0.218379 Oct 27 09:39:32.314536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 230/463] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:32 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1443 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:32.320959 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7d165f84-dd3c-404a-abec-d876dc6c5261 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.207137 Oct 27 09:39:32.321531 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 234/464] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:32 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:32.336376 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6f319ee7-6532-40b8-bd06-d913c6c6e2e1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:32.337027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6f319ee7-6532-40b8-bd06-d913c6c6e2e1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:32.343335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f319ee7-6532-40b8-bd06-d913c6c6e2e1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:32.343810 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f319ee7-6532-40b8-bd06-d913c6c6e2e1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:32.344236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f319ee7-6532-40b8-bd06-d913c6c6e2e1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:32.344949 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f319ee7-6532-40b8-bd06-d913c6c6e2e1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:32.345393 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f319ee7-6532-40b8-bd06-d913c6c6e2e1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:32.345806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f319ee7-6532-40b8-bd06-d913c6c6e2e1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:32.473911 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6f319ee7-6532-40b8-bd06-d913c6c6e2e1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:32.482182 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6f319ee7-6532-40b8-bd06-d913c6c6e2e1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1443 microversion: 2.1 time: 0.149600 Oct 27 09:39:32.482750 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 231/465] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:32 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:33.115886 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1b822733-337d-4aac-b562-26a393ed8a9d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:33.116559 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1b822733-337d-4aac-b562-26a393ed8a9d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:33.127587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:33.128740 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:33.132274 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1b822733-337d-4aac-b562-26a393ed8a9d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:33.132802 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1b822733-337d-4aac-b562-26a393ed8a9d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:33.133240 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1b822733-337d-4aac-b562-26a393ed8a9d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:33.134253 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1b822733-337d-4aac-b562-26a393ed8a9d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:33.134883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1b822733-337d-4aac-b562-26a393ed8a9d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:33.135317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1b822733-337d-4aac-b562-26a393ed8a9d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:33.135710 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:33.136260 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:33.137499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:33.138288 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:33.138810 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:33.139301 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:33.441529 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1b822733-337d-4aac-b562-26a393ed8a9d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:33.450390 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:33.450636 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1b822733-337d-4aac-b562-26a393ed8a9d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.338706 Oct 27 09:39:33.451423 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 235/466] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:33 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:33.459506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:33.460993 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:33.462254 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-902777bb-ce23-4eb4-b35a-8587baee1183 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.339206 Oct 27 09:39:33.463057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 232/467] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:33 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:33.471909 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9b9a2f67-c344-48f2-8c15-89aa9ff70bdf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:33.472551 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9b9a2f67-c344-48f2-8c15-89aa9ff70bdf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:33.478529 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9a2f67-c344-48f2-8c15-89aa9ff70bdf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:33.479012 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9a2f67-c344-48f2-8c15-89aa9ff70bdf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:33.479444 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9a2f67-c344-48f2-8c15-89aa9ff70bdf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:33.480647 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9a2f67-c344-48f2-8c15-89aa9ff70bdf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:33.481114 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9a2f67-c344-48f2-8c15-89aa9ff70bdf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:33.481538 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9a2f67-c344-48f2-8c15-89aa9ff70bdf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:33.694858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9b9a2f67-c344-48f2-8c15-89aa9ff70bdf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:33.703549 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9b9a2f67-c344-48f2-8c15-89aa9ff70bdf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.237053 Oct 27 09:39:33.704130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 236/468] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:33 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:34.478044 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6f13649f-ec11-47dc-bdfe-bf04b2297f95 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:34.478718 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6f13649f-ec11-47dc-bdfe-bf04b2297f95 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:34.485852 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f13649f-ec11-47dc-bdfe-bf04b2297f95 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.486347 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f13649f-ec11-47dc-bdfe-bf04b2297f95 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.486843 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f13649f-ec11-47dc-bdfe-bf04b2297f95 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.487559 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f13649f-ec11-47dc-bdfe-bf04b2297f95 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.488015 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f13649f-ec11-47dc-bdfe-bf04b2297f95 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.488437 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6f13649f-ec11-47dc-bdfe-bf04b2297f95 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.489440 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:34.490048 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:34.496796 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.497277 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.497702 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.498390 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.499013 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.499440 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.781450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:34.783840 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6f13649f-ec11-47dc-bdfe-bf04b2297f95 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:34.790289 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:34.791674 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6f13649f-ec11-47dc-bdfe-bf04b2297f95 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.317461 Oct 27 09:39:34.791830 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:34.792919 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-420aa180-360f-4ddd-a772-43bea4b741f2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1721 microversion: 2.20 time: 0.307734 Oct 27 09:39:34.793583 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 237/469] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:34 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:39:34.798320 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f1f3157a-2190-4750-aff4-0fedd74e4828 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:34.798937 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f1f3157a-2190-4750-aff4-0fedd74e4828 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:34.812651 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f1f3157a-2190-4750-aff4-0fedd74e4828 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.812651 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f1f3157a-2190-4750-aff4-0fedd74e4828 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.812651 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f1f3157a-2190-4750-aff4-0fedd74e4828 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.812651 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f1f3157a-2190-4750-aff4-0fedd74e4828 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.813111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f1f3157a-2190-4750-aff4-0fedd74e4828 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.813111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f1f3157a-2190-4750-aff4-0fedd74e4828 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.813257 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 233/470] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:34 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:34.819007 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-6607ef58-3b2e-42e5-932a-3421f4fd937b req-c4cf1c29-8674-44f1-9afd-f7191479ecad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596c5c1c-3555-40e9-a2d3-6c6300478846", "tag": "af533890-8a09-4e93-ac93-881cbb38ca23"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:34.829205 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6607ef58-3b2e-42e5-932a-3421f4fd937b req-c4cf1c29-8674-44f1-9afd-f7191479ecad service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.829688 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6607ef58-3b2e-42e5-932a-3421f4fd937b req-c4cf1c29-8674-44f1-9afd-f7191479ecad service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.830115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6607ef58-3b2e-42e5-932a-3421f4fd937b req-c4cf1c29-8674-44f1-9afd-f7191479ecad service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.841409 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-6607ef58-3b2e-42e5-932a-3421f4fd937b req-c4cf1c29-8674-44f1-9afd-f7191479ecad service nova] Creating event network-changed:af533890-8a09-4e93-ac93-881cbb38ca23 for instance 596c5c1c-3555-40e9-a2d3-6c6300478846 on hv-cinder-79797 Oct 27 09:39:34.847786 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-6607ef58-3b2e-42e5-932a-3421f4fd937b req-c4cf1c29-8674-44f1-9afd-f7191479ecad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033675 Oct 27 09:39:34.848384 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 234/471] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:34.925539 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a81df054-f57c-4f1e-8083-3e0089a3a0ed tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:34.926370 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a81df054-f57c-4f1e-8083-3e0089a3a0ed tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:34.938365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a81df054-f57c-4f1e-8083-3e0089a3a0ed tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.939237 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a81df054-f57c-4f1e-8083-3e0089a3a0ed tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.939823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a81df054-f57c-4f1e-8083-3e0089a3a0ed tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:34.941718 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a81df054-f57c-4f1e-8083-3e0089a3a0ed tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:34.943016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a81df054-f57c-4f1e-8083-3e0089a3a0ed tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:34.943650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a81df054-f57c-4f1e-8083-3e0089a3a0ed tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:35.001165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a81df054-f57c-4f1e-8083-3e0089a3a0ed tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:39:35.012500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f1f3157a-2190-4750-aff4-0fedd74e4828 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:35.023072 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f1f3157a-2190-4750-aff4-0fedd74e4828 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.228367 Oct 27 09:39:35.024606 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 238/472] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:34 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:35.125497 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a81df054-f57c-4f1e-8083-3e0089a3a0ed tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "DELETE /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 204 len: 0 microversion: 2.1 time: 0.203774 Oct 27 09:39:35.130538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 235/473] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:39:34 2022] DELETE /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:39:35.137669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-13a93084-172b-427c-ad48-01ffcc904269 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:35.139218 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-13a93084-172b-427c-ad48-01ffcc904269 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:35.150637 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-13a93084-172b-427c-ad48-01ffcc904269 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:35.151036 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-13a93084-172b-427c-ad48-01ffcc904269 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:35.151467 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-13a93084-172b-427c-ad48-01ffcc904269 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:35.152768 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-13a93084-172b-427c-ad48-01ffcc904269 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:35.153224 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-13a93084-172b-427c-ad48-01ffcc904269 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:35.153650 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-13a93084-172b-427c-ad48-01ffcc904269 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:35.316133 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-13a93084-172b-427c-ad48-01ffcc904269 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:35.323934 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-13a93084-172b-427c-ad48-01ffcc904269 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1513 microversion: 2.1 time: 0.192336 Oct 27 09:39:35.324502 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 239/474] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:35 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:35.819610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:35.820317 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:35.825642 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-71d2a077-5834-40e8-9d8b-707d611cbc93 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:35.826255 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-71d2a077-5834-40e8-9d8b-707d611cbc93 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:35.827448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:35.828202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:35.828723 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:35.829426 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:35.829887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:35.830312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:35.832816 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71d2a077-5834-40e8-9d8b-707d611cbc93 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:35.833262 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71d2a077-5834-40e8-9d8b-707d611cbc93 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:35.833710 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71d2a077-5834-40e8-9d8b-707d611cbc93 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:35.834428 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71d2a077-5834-40e8-9d8b-707d611cbc93 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:35.834884 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71d2a077-5834-40e8-9d8b-707d611cbc93 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:35.835339 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-71d2a077-5834-40e8-9d8b-707d611cbc93 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.041256 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:36.049316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-71d2a077-5834-40e8-9d8b-707d611cbc93 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:36.050209 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:36.051658 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:36.052831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0663d504-f90c-4d4d-b2e3-6a90b40df6e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1724 microversion: 2.20 time: 0.238022 Oct 27 09:39:36.053387 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 236/475] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:35 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:39:36.057132 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-71d2a077-5834-40e8-9d8b-707d611cbc93 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.235936 Oct 27 09:39:36.057958 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 240/476] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:35 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:36.060034 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1ac23f16-2938-4b09-b5ca-b011e9f6d7d0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:36.060682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1ac23f16-2938-4b09-b5ca-b011e9f6d7d0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:36.066729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1ac23f16-2938-4b09-b5ca-b011e9f6d7d0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:36.067333 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1ac23f16-2938-4b09-b5ca-b011e9f6d7d0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:36.067766 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1ac23f16-2938-4b09-b5ca-b011e9f6d7d0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.068568 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1ac23f16-2938-4b09-b5ca-b011e9f6d7d0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:36.069023 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1ac23f16-2938-4b09-b5ca-b011e9f6d7d0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:36.069505 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1ac23f16-2938-4b09-b5ca-b011e9f6d7d0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.081168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2e09a2ad-de43-47e9-9c82-7831b9c2f5f6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fcc1572-3193-486f-9cb6-c72864576d76"}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:36.083847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2e09a2ad-de43-47e9-9c82-7831b9c2f5f6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:36.090690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e09a2ad-de43-47e9-9c82-7831b9c2f5f6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:36.090690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e09a2ad-de43-47e9-9c82-7831b9c2f5f6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:36.091220 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e09a2ad-de43-47e9-9c82-7831b9c2f5f6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.091928 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e09a2ad-de43-47e9-9c82-7831b9c2f5f6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:36.092545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e09a2ad-de43-47e9-9c82-7831b9c2f5f6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:36.092975 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e09a2ad-de43-47e9-9c82-7831b9c2f5f6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.221761 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1ac23f16-2938-4b09-b5ca-b011e9f6d7d0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:36.233103 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1ac23f16-2938-4b09-b5ca-b011e9f6d7d0 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.178198 Oct 27 09:39:36.233600 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 237/477] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:36 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:36.337439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:36.349583 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7f5332b9-9da4-426b-8352-0ef37b017276 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:36.350199 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7f5332b9-9da4-426b-8352-0ef37b017276 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:36.357597 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f5332b9-9da4-426b-8352-0ef37b017276 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:36.358078 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f5332b9-9da4-426b-8352-0ef37b017276 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:36.358708 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f5332b9-9da4-426b-8352-0ef37b017276 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.359578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f5332b9-9da4-426b-8352-0ef37b017276 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:36.360916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f5332b9-9da4-426b-8352-0ef37b017276 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:36.361667 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f5332b9-9da4-426b-8352-0ef37b017276 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.455554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2e09a2ad-de43-47e9-9c82-7831b9c2f5f6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "POST /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.378822 Oct 27 09:39:36.456375 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 241/478] 10.222.0.70 () {62 vars in 1364 bytes} [Thu Oct 27 09:39:36 2022] POST /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-volume_attachments => generated 188 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 09:39:36.507023 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7f5332b9-9da4-426b-8352-0ef37b017276 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:36.515894 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7f5332b9-9da4-426b-8352-0ef37b017276 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1513 microversion: 2.1 time: 0.171728 Oct 27 09:39:36.516467 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 238/479] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:36 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:36.587831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-67fcdfa9-1182-4cee-915f-0be29b4930ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:36.588414 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-67fcdfa9-1182-4cee-915f-0be29b4930ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:36.596329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fcdfa9-1182-4cee-915f-0be29b4930ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:36.596844 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fcdfa9-1182-4cee-915f-0be29b4930ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:36.597265 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fcdfa9-1182-4cee-915f-0be29b4930ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.597935 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fcdfa9-1182-4cee-915f-0be29b4930ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:36.598376 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fcdfa9-1182-4cee-915f-0be29b4930ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:36.598788 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fcdfa9-1182-4cee-915f-0be29b4930ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.639754 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-67fcdfa9-1182-4cee-915f-0be29b4930ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125361) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 09:39:36.705884 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-67fcdfa9-1182-4cee-915f-0be29b4930ec tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "POST /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/action" status: 202 len: 0 microversion: 2.20 time: 0.121972 Oct 27 09:39:36.706655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 242/480] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Oct 27 09:39:36 2022] POST /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:39:36.715203 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:36.715836 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:36.721812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:36.722300 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:36.722740 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.723436 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:36.723892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:36.724320 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:36.858782 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:36.869091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:36.870380 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:36.872061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-47487b8a-77c4-4970-a6fa-78f854b95d46 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1810 microversion: 2.20 time: 0.161445 Oct 27 09:39:36.884613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 239/481] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:36 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:37.081193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d3ec7202-bb60-4981-81d0-957d5d6c27e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:37.082048 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d3ec7202-bb60-4981-81d0-957d5d6c27e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:37.088130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d3ec7202-bb60-4981-81d0-957d5d6c27e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:37.088733 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d3ec7202-bb60-4981-81d0-957d5d6c27e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:37.089252 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d3ec7202-bb60-4981-81d0-957d5d6c27e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:37.090540 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d3ec7202-bb60-4981-81d0-957d5d6c27e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:37.091066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d3ec7202-bb60-4981-81d0-957d5d6c27e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:37.091551 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d3ec7202-bb60-4981-81d0-957d5d6c27e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:37.254959 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-612a54e5-467e-4b9c-b358-4f0728404e9e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:37.255761 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-612a54e5-467e-4b9c-b358-4f0728404e9e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:37.265898 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-612a54e5-467e-4b9c-b358-4f0728404e9e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:37.266656 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-612a54e5-467e-4b9c-b358-4f0728404e9e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:37.267336 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-612a54e5-467e-4b9c-b358-4f0728404e9e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:37.268510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-612a54e5-467e-4b9c-b358-4f0728404e9e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:37.269180 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-612a54e5-467e-4b9c-b358-4f0728404e9e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:37.269904 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-612a54e5-467e-4b9c-b358-4f0728404e9e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:37.419600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d3ec7202-bb60-4981-81d0-957d5d6c27e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:37.427582 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d3ec7202-bb60-4981-81d0-957d5d6c27e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.350512 Oct 27 09:39:37.428373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 243/482] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:37 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:37.493010 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-612a54e5-467e-4b9c-b358-4f0728404e9e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:37.502569 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-612a54e5-467e-4b9c-b358-4f0728404e9e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.251308 Oct 27 09:39:37.503335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 240/483] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:37 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:37.544658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6321f9d6-e2e6-405c-9512-3a17aa17ac4f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:37.545746 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6321f9d6-e2e6-405c-9512-3a17aa17ac4f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:37.553313 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6321f9d6-e2e6-405c-9512-3a17aa17ac4f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:37.553915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6321f9d6-e2e6-405c-9512-3a17aa17ac4f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:37.554459 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6321f9d6-e2e6-405c-9512-3a17aa17ac4f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:37.555263 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6321f9d6-e2e6-405c-9512-3a17aa17ac4f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:37.555825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6321f9d6-e2e6-405c-9512-3a17aa17ac4f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:37.556466 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6321f9d6-e2e6-405c-9512-3a17aa17ac4f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:37.809837 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6321f9d6-e2e6-405c-9512-3a17aa17ac4f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:37.817500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6321f9d6-e2e6-405c-9512-3a17aa17ac4f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1513 microversion: 2.1 time: 0.279145 Oct 27 09:39:37.818005 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 244/484] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:37 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1513 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:37.897861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:37.898502 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:37.905616 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:37.906107 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:37.906546 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:37.907244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:37.907698 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:37.908123 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:38.039192 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:38.048339 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:38.049813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:38.050968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-836cd5ed-d0bf-4542-bf49-cc491ad84a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1810 microversion: 2.20 time: 0.157048 Oct 27 09:39:38.051517 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 241/485] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:37 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:38.116783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a9e356a3-8600-4048-af2a-a23fabf03e4f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:38.117277 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a9e356a3-8600-4048-af2a-a23fabf03e4f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:38.123773 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9e356a3-8600-4048-af2a-a23fabf03e4f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:38.124257 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9e356a3-8600-4048-af2a-a23fabf03e4f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:38.124714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9e356a3-8600-4048-af2a-a23fabf03e4f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:38.125406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9e356a3-8600-4048-af2a-a23fabf03e4f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:38.125854 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9e356a3-8600-4048-af2a-a23fabf03e4f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:38.126272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a9e356a3-8600-4048-af2a-a23fabf03e4f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:38.149623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a9e356a3-8600-4048-af2a-a23fabf03e4f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/ips" status: 200 len: 149 microversion: 2.1 time: 0.036544 Oct 27 09:39:38.150191 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 245/486] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Oct 27 09:39:38 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:39:38.252633 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-0ff9f614-9c22-4214-a8ae-3dfd8fde1060 req-a0e5b363-f980-45ff-86a0-fd51b7fe77ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2612979-fbed-42ac-b725-265018416862", "name": "network-vif-plugged", "status": "completed", "tag": "3a528390-aec1-4a57-8443-f4bdcd15f187"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:38.262802 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-0ff9f614-9c22-4214-a8ae-3dfd8fde1060 req-a0e5b363-f980-45ff-86a0-fd51b7fe77ab service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:38.263745 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-0ff9f614-9c22-4214-a8ae-3dfd8fde1060 req-a0e5b363-f980-45ff-86a0-fd51b7fe77ab service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:38.264433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-0ff9f614-9c22-4214-a8ae-3dfd8fde1060 req-a0e5b363-f980-45ff-86a0-fd51b7fe77ab service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:38.276007 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-0ff9f614-9c22-4214-a8ae-3dfd8fde1060 req-a0e5b363-f980-45ff-86a0-fd51b7fe77ab service nova] Creating event network-vif-plugged:3a528390-aec1-4a57-8443-f4bdcd15f187 for instance d2612979-fbed-42ac-b725-265018416862 on hv-cinder-79797 Oct 27 09:39:38.286470 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-0ff9f614-9c22-4214-a8ae-3dfd8fde1060 req-a0e5b363-f980-45ff-86a0-fd51b7fe77ab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037625 Oct 27 09:39:38.287257 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 242/487] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:39:38.451376 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9e0f8aae-ceb8-4b3d-8c7a-62d4c75ed204 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:38.451982 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9e0f8aae-ceb8-4b3d-8c7a-62d4c75ed204 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:38.458288 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e0f8aae-ceb8-4b3d-8c7a-62d4c75ed204 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:38.458764 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e0f8aae-ceb8-4b3d-8c7a-62d4c75ed204 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:38.459197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e0f8aae-ceb8-4b3d-8c7a-62d4c75ed204 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:38.459873 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e0f8aae-ceb8-4b3d-8c7a-62d4c75ed204 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:38.461038 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e0f8aae-ceb8-4b3d-8c7a-62d4c75ed204 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:38.461466 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e0f8aae-ceb8-4b3d-8c7a-62d4c75ed204 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:38.527347 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-20afe71f-da11-4005-acdf-440f7a41302a tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:38.528052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-20afe71f-da11-4005-acdf-440f7a41302a tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:38.534175 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-20afe71f-da11-4005-acdf-440f7a41302a tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:38.534665 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-20afe71f-da11-4005-acdf-440f7a41302a tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:38.535103 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-20afe71f-da11-4005-acdf-440f7a41302a tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:38.536255 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-20afe71f-da11-4005-acdf-440f7a41302a tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:38.536255 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-20afe71f-da11-4005-acdf-440f7a41302a tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:38.536721 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-20afe71f-da11-4005-acdf-440f7a41302a tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:38.641629 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9e0f8aae-ceb8-4b3d-8c7a-62d4c75ed204 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:38.649892 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9e0f8aae-ceb8-4b3d-8c7a-62d4c75ed204 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.202900 Oct 27 09:39:38.650457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 246/488] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:38 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:38.685922 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-20afe71f-da11-4005-acdf-440f7a41302a tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:38.693616 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-20afe71f-da11-4005-acdf-440f7a41302a tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.171018 Oct 27 09:39:38.694182 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 243/489] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:38 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:38.841427 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6bd9f824-5143-40d1-97a9-a8a19612f5f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:38.842025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6bd9f824-5143-40d1-97a9-a8a19612f5f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:38.847844 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bd9f824-5143-40d1-97a9-a8a19612f5f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:38.848319 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bd9f824-5143-40d1-97a9-a8a19612f5f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:38.848779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bd9f824-5143-40d1-97a9-a8a19612f5f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:38.849449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bd9f824-5143-40d1-97a9-a8a19612f5f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:38.849893 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bd9f824-5143-40d1-97a9-a8a19612f5f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:38.850306 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bd9f824-5143-40d1-97a9-a8a19612f5f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.079620 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:39.084933 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:39.093154 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.093645 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.094082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.096073 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.096571 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.097004 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.206256 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6bd9f824-5143-40d1-97a9-a8a19612f5f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:39.214417 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6bd9f824-5143-40d1-97a9-a8a19612f5f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1513 microversion: 2.1 time: 0.377323 Oct 27 09:39:39.215577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 247/490] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:38 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1513 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:39.347778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:39.357189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:39.358925 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:39.360076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8c5701d7-6ae6-4113-8658-4827388cc5d7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1810 microversion: 2.20 time: 0.286392 Oct 27 09:39:39.360648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 244/491] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:39 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1810 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:39.536124 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ebb56926-851a-4112-851c-16f110b4e07d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf79691a-1708-4f55-80a1-2b2f378c46eb"}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:39.538797 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ebb56926-851a-4112-851c-16f110b4e07d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:39.544973 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebb56926-851a-4112-851c-16f110b4e07d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.545464 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebb56926-851a-4112-851c-16f110b4e07d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.545884 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebb56926-851a-4112-851c-16f110b4e07d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.546577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebb56926-851a-4112-851c-16f110b4e07d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.547030 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebb56926-851a-4112-851c-16f110b4e07d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.547450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebb56926-851a-4112-851c-16f110b4e07d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.553027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-896fff26-eb87-4d29-bc20-9a28e1909499 req-e96404f5-c53c-402d-b1fc-b9a44e1b91be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acba3b76-8223-4305-80d8-e739b12c6fcf", "name": "network-vif-deleted", "tag": "265c29a2-64eb-4729-84e0-8504919ac033"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:39.562566 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-896fff26-eb87-4d29-bc20-9a28e1909499 req-e96404f5-c53c-402d-b1fc-b9a44e1b91be service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.563047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-896fff26-eb87-4d29-bc20-9a28e1909499 req-e96404f5-c53c-402d-b1fc-b9a44e1b91be service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.563475 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-896fff26-eb87-4d29-bc20-9a28e1909499 req-e96404f5-c53c-402d-b1fc-b9a44e1b91be service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.575054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-896fff26-eb87-4d29-bc20-9a28e1909499 req-e96404f5-c53c-402d-b1fc-b9a44e1b91be service nova] Creating event network-vif-deleted:265c29a2-64eb-4729-84e0-8504919ac033 for instance acba3b76-8223-4305-80d8-e739b12c6fcf on hv-cinder-79797 Oct 27 09:39:39.580626 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-896fff26-eb87-4d29-bc20-9a28e1909499 req-e96404f5-c53c-402d-b1fc-b9a44e1b91be service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031377 Oct 27 09:39:39.581208 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 245/492] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:39:39.673264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2e44da9d-68ab-4d62-a469-f7e3b598c934 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:39.673944 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2e44da9d-68ab-4d62-a469-f7e3b598c934 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:39.680294 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e44da9d-68ab-4d62-a469-f7e3b598c934 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.680798 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e44da9d-68ab-4d62-a469-f7e3b598c934 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.681224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e44da9d-68ab-4d62-a469-f7e3b598c934 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.681902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e44da9d-68ab-4d62-a469-f7e3b598c934 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.682349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e44da9d-68ab-4d62-a469-f7e3b598c934 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.682767 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e44da9d-68ab-4d62-a469-f7e3b598c934 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.686710 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:39.850961 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2e44da9d-68ab-4d62-a469-f7e3b598c934 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:39.859321 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2e44da9d-68ab-4d62-a469-f7e3b598c934 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.190199 Oct 27 09:39:39.860049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 246/493] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:39 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:39.864716 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6471b228-18c5-4162-9a3a-b34c4095ea76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:39.865280 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6471b228-18c5-4162-9a3a-b34c4095ea76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:39.872425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6471b228-18c5-4162-9a3a-b34c4095ea76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.873743 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6471b228-18c5-4162-9a3a-b34c4095ea76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.873743 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6471b228-18c5-4162-9a3a-b34c4095ea76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:39.874558 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6471b228-18c5-4162-9a3a-b34c4095ea76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:39.875236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6471b228-18c5-4162-9a3a-b34c4095ea76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:39.875879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6471b228-18c5-4162-9a3a-b34c4095ea76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:40.068310 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ebb56926-851a-4112-851c-16f110b4e07d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535948 Oct 27 09:39:40.068959 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 248/494] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:39:39 2022] POST /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:40.080449 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6471b228-18c5-4162-9a3a-b34c4095ea76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:40.091353 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6471b228-18c5-4162-9a3a-b34c4095ea76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.230094 Oct 27 09:39:40.092057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 247/495] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:39 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:40.237723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:40.238419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:40.244359 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:40.244878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:40.245313 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:40.246011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:40.246457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:40.246879 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:40.279194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:40.279595 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:40.280030 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:40.280482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lazy-loading 'fault' on Instance uuid acba3b76-8223-4305-80d8-e739b12c6fcf {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:39:40.327547 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:40.335978 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-beb90457-b4d1-4eee-b996-761b8783c320 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1309 microversion: 2.1 time: 0.102772 Oct 27 09:39:40.336595 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 249/496] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:40 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:40.387491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:40.388108 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:40.394622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:40.395112 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:40.395558 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:40.396257 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:40.396750 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:40.397177 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:40.594433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:40.615795 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:40.621070 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:40.622346 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c7f0ed34-3ec1-41ae-a5b3-bee5598ca3a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1752 microversion: 2.20 time: 0.239393 Oct 27 09:39:40.622983 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 248/497] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:40 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1752 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:40.882128 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ecd805df-4a23-4445-b5b8-ca4a0ce3215e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:40.882733 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ecd805df-4a23-4445-b5b8-ca4a0ce3215e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:40.889859 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ecd805df-4a23-4445-b5b8-ca4a0ce3215e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:40.890345 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ecd805df-4a23-4445-b5b8-ca4a0ce3215e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:40.890779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ecd805df-4a23-4445-b5b8-ca4a0ce3215e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:40.891469 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ecd805df-4a23-4445-b5b8-ca4a0ce3215e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:40.891922 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ecd805df-4a23-4445-b5b8-ca4a0ce3215e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:40.892344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ecd805df-4a23-4445-b5b8-ca4a0ce3215e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:41.025469 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ecd805df-4a23-4445-b5b8-ca4a0ce3215e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:41.034733 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ecd805df-4a23-4445-b5b8-ca4a0ce3215e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1372 microversion: 2.1 time: 0.156200 Oct 27 09:39:41.035554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 250/498] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:40 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:41.115064 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4e123759-2937-468e-9158-0e759f3b2f76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:41.115757 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4e123759-2937-468e-9158-0e759f3b2f76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:41.122523 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4e123759-2937-468e-9158-0e759f3b2f76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:41.123013 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4e123759-2937-468e-9158-0e759f3b2f76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:41.123452 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4e123759-2937-468e-9158-0e759f3b2f76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:41.124153 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4e123759-2937-468e-9158-0e759f3b2f76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:41.124634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4e123759-2937-468e-9158-0e759f3b2f76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:41.125061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4e123759-2937-468e-9158-0e759f3b2f76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:41.260778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4e123759-2937-468e-9158-0e759f3b2f76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:41.268461 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4e123759-2937-468e-9158-0e759f3b2f76 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.157444 Oct 27 09:39:41.269055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 249/499] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:41 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:41.360726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:41.361506 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:41.370046 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:41.371069 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:41.371848 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:41.373280 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:41.374205 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:41.375011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:41.408836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:41.409311 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:41.409748 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:41.410193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lazy-loading 'fault' on Instance uuid acba3b76-8223-4305-80d8-e739b12c6fcf {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:39:41.450151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:41.458022 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5be2200f-2c25-40ad-9ac1-9c4bae54c472 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 200 len: 1309 microversion: 2.1 time: 0.102565 Oct 27 09:39:41.458587 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 251/500] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:41 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:41.649726 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:41.650258 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:41.656676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:41.657157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:41.657595 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:41.658281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:41.658736 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:41.659158 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:41.786183 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:41.794899 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:41.796343 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:41.797585 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9da99ed7-0413-4ada-99c8-c7267a876a65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1752 microversion: 2.20 time: 0.151828 Oct 27 09:39:41.798136 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 250/501] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:41 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:42.058853 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8df863ed-67cb-4c5b-8d22-f84dd9bc78e6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:42.059454 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8df863ed-67cb-4c5b-8d22-f84dd9bc78e6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:42.065623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8df863ed-67cb-4c5b-8d22-f84dd9bc78e6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.066099 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8df863ed-67cb-4c5b-8d22-f84dd9bc78e6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.066522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8df863ed-67cb-4c5b-8d22-f84dd9bc78e6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.067196 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8df863ed-67cb-4c5b-8d22-f84dd9bc78e6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.067643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8df863ed-67cb-4c5b-8d22-f84dd9bc78e6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.068058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8df863ed-67cb-4c5b-8d22-f84dd9bc78e6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.203191 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-8df863ed-67cb-4c5b-8d22-f84dd9bc78e6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:42.211172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8df863ed-67cb-4c5b-8d22-f84dd9bc78e6 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1566 microversion: 2.1 time: 0.156082 Oct 27 09:39:42.211669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 252/502] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:42 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:42.238976 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f8decc3a-7b1d-4b9d-abf2-8229dd76ab96 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:42.244548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f8decc3a-7b1d-4b9d-abf2-8229dd76ab96 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:42.258274 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8decc3a-7b1d-4b9d-abf2-8229dd76ab96 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.268136 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8decc3a-7b1d-4b9d-abf2-8229dd76ab96 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.268693 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8decc3a-7b1d-4b9d-abf2-8229dd76ab96 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.269577 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8decc3a-7b1d-4b9d-abf2-8229dd76ab96 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.270049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8decc3a-7b1d-4b9d-abf2-8229dd76ab96 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.270475 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8decc3a-7b1d-4b9d-abf2-8229dd76ab96 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.292061 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-8401965d-2174-4ec4-bd59-9765767660ef req-302ccdbc-b291-477a-a1c6-315e1239cdbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc27f94-5b44-482f-9d13-b102e27b7a10", "name": "network-vif-plugged", "status": "completed", "tag": "7969c643-a189-494b-ab3e-877a44420350"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:42.305886 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-8401965d-2174-4ec4-bd59-9765767660ef req-302ccdbc-b291-477a-a1c6-315e1239cdbf service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.307067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-8401965d-2174-4ec4-bd59-9765767660ef req-302ccdbc-b291-477a-a1c6-315e1239cdbf service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.307615 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-8401965d-2174-4ec4-bd59-9765767660ef req-302ccdbc-b291-477a-a1c6-315e1239cdbf service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.322639 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-8401965d-2174-4ec4-bd59-9765767660ef req-302ccdbc-b291-477a-a1c6-315e1239cdbf service nova] Creating event network-vif-plugged:7969c643-a189-494b-ab3e-877a44420350 for instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 on hv-cinder-79797 Oct 27 09:39:42.329565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-8401965d-2174-4ec4-bd59-9765767660ef req-302ccdbc-b291-477a-a1c6-315e1239cdbf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043789 Oct 27 09:39:42.331088 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 253/503] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:42.337066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c033b745-c0b4-41a7-9194-0e24fe90db54 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:42.338766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c033b745-c0b4-41a7-9194-0e24fe90db54 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:42.350146 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c033b745-c0b4-41a7-9194-0e24fe90db54 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.351334 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c033b745-c0b4-41a7-9194-0e24fe90db54 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.352701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c033b745-c0b4-41a7-9194-0e24fe90db54 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.355431 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c033b745-c0b4-41a7-9194-0e24fe90db54 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.355905 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c033b745-c0b4-41a7-9194-0e24fe90db54 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.356552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c033b745-c0b4-41a7-9194-0e24fe90db54 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.419276 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f8decc3a-7b1d-4b9d-abf2-8229dd76ab96 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187792 Oct 27 09:39:42.420731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 251/504] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Oct 27 09:39:42 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:42.482183 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:42.483248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: acba3b76-8223-4305-80d8-e739b12c6fcf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:42.490212 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.491591 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.492262 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.494469 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.495779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.496213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.510635 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] HTTP exception thrown: Instance acba3b76-8223-4305-80d8-e739b12c6fcf could not be found. Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Request method failure captured: Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf HTTP/1.1 Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-_QtU3GtgRW8vzkc0yf0CGO_8K1dq4DRhUgmfhoUIQOCLJkI7Y1bGI1YY7ZNWnbp0itpMW3UVEa9qG-PARp5pS5zKcLZVJgJnpnlDC9lql8lt1iIptll5BcOsGSOGy5q7bKICBdSI_jUiTFh4cWz_mF-0h1oNvXqzoB_DJ7nKry4 Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 9dc4fbf213f04cd7ab49abad693a1cf2 Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-VolumesSnapshotTestJSON-367450342 Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:39:42.513756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9dc4fbf213f04cd7ab49abad693a1cf2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9dc4fbf213f04cd7ab49abad693a1cf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9dc4fbf213f04cd7ab49abad693a1cf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9dc4fbf213f04cd7ab49abad693a1cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-VolumesSnapshotTestJSON-367450342 Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 9dc4fbf213f04cd7ab49abad693a1cf2 Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-367450342 Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-VolumesSnapshotTestJSON-367450342-project Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: b4e4e3b5ce544725b1f4a439596314a8 Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-VolumesSnapshotTestJSON-367450342-project Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance acba3b76-8223-4305-80d8-e739b12c6fcf could not be found. Oct 27 09:39:42.515297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': 'acba3b76-8223-4305-80d8-e739b12c6fcf'} Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acba3b76-8223-4305-80d8-e739b12c6fcf could not be found. Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:39:42.516373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acba3b76-8223-4305-80d8-e739b12c6fcf could not be found. Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acba3b76-8223-4305-80d8-e739b12c6fcf could not be found. Oct 27 09:39:42.518536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:39:42.521262 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Returning 404 to user: Instance acba3b76-8223-4305-80d8-e739b12c6fcf could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:39:42.522444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a0c1f1bb-f82b-4c17-ab86-5cd49b4d1689 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf" status: 404 len: 111 microversion: 2.1 time: 0.046078 Oct 27 09:39:42.523515 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 252/505] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:42 2022] GET /compute/v2.1/servers/acba3b76-8223-4305-80d8-e739b12c6fcf => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:39:42.577368 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c033b745-c0b4-41a7-9194-0e24fe90db54 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:42.585917 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c033b745-c0b4-41a7-9194-0e24fe90db54 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.253485 Oct 27 09:39:42.589742 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 254/506] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:42 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:42.822870 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:42.824031 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:42.830761 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.831240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.831679 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.832363 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:42.833013 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:42.833401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:42.973661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:42.983349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:42.985345 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:42.986523 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-73772b0d-181f-4a43-bfe8-ce5f944c645a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1752 microversion: 2.20 time: 0.167620 Oct 27 09:39:43.000994 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 253/507] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:42 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:43.430967 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-5a6cc7be-92a7-4437-8755-79750b994b52 req-4f52020e-bafb-47b0-b504-2e84ccc6e43f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2612979-fbed-42ac-b725-265018416862", "tag": "3a528390-aec1-4a57-8443-f4bdcd15f187"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:43.441425 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5a6cc7be-92a7-4437-8755-79750b994b52 req-4f52020e-bafb-47b0-b504-2e84ccc6e43f service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:43.441900 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5a6cc7be-92a7-4437-8755-79750b994b52 req-4f52020e-bafb-47b0-b504-2e84ccc6e43f service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:43.442331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5a6cc7be-92a7-4437-8755-79750b994b52 req-4f52020e-bafb-47b0-b504-2e84ccc6e43f service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:43.454268 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-5a6cc7be-92a7-4437-8755-79750b994b52 req-4f52020e-bafb-47b0-b504-2e84ccc6e43f service nova] Creating event network-changed:3a528390-aec1-4a57-8443-f4bdcd15f187 for instance d2612979-fbed-42ac-b725-265018416862 on hv-cinder-79797 Oct 27 09:39:43.459066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-5a6cc7be-92a7-4437-8755-79750b994b52 req-4f52020e-bafb-47b0-b504-2e84ccc6e43f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031677 Oct 27 09:39:43.459663 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 255/508] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:43.611958 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b4361678-9a40-46d1-953d-bae7ff911f11 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:43.612732 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b4361678-9a40-46d1-953d-bae7ff911f11 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:43.619128 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b4361678-9a40-46d1-953d-bae7ff911f11 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:43.619635 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b4361678-9a40-46d1-953d-bae7ff911f11 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:43.620065 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b4361678-9a40-46d1-953d-bae7ff911f11 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:43.621291 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b4361678-9a40-46d1-953d-bae7ff911f11 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:43.621738 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b4361678-9a40-46d1-953d-bae7ff911f11 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:43.622153 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b4361678-9a40-46d1-953d-bae7ff911f11 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:43.752383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b4361678-9a40-46d1-953d-bae7ff911f11 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:43.760529 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b4361678-9a40-46d1-953d-bae7ff911f11 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.152354 Oct 27 09:39:43.762057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 254/509] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:43 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:44.014310 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:44.015000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:44.021010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:44.021508 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:44.022020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:44.022658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:44.023105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:44.023526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:44.028149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=92,nova_cell1:UPDATE=5 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:44.158851 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:44.167803 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:44.169289 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:44.170456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-168a30be-0fe6-46bd-bfba-0aa4ec205124 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1752 microversion: 2.20 time: 0.161116 Oct 27 09:39:44.171024 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 256/510] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:44 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:44.783401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3942389e-a207-48f4-a1e9-1070662b4821 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:44.784127 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-3942389e-a207-48f4-a1e9-1070662b4821 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:44.790406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3942389e-a207-48f4-a1e9-1070662b4821 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:44.790893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3942389e-a207-48f4-a1e9-1070662b4821 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:44.791312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3942389e-a207-48f4-a1e9-1070662b4821 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:44.791997 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3942389e-a207-48f4-a1e9-1070662b4821 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:44.792444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3942389e-a207-48f4-a1e9-1070662b4821 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:44.792885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3942389e-a207-48f4-a1e9-1070662b4821 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:44.922362 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-3942389e-a207-48f4-a1e9-1070662b4821 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:44.929900 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3942389e-a207-48f4-a1e9-1070662b4821 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.150294 Oct 27 09:39:44.930453 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 255/511] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:44 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:45.195093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:45.195698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:45.202153 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:45.202631 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:45.203319 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:45.203993 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:45.204436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:45.204885 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:45.334181 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:45.343094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:45.344844 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:45.345707 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5dcc24ed-4509-43ad-9157-67af215d94f1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1752 microversion: 2.20 time: 0.154461 Oct 27 09:39:45.346335 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 257/512] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:45 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:45.951589 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2adbda94-81f3-473d-9976-62f576de3902 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:45.952235 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2adbda94-81f3-473d-9976-62f576de3902 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:45.959002 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2adbda94-81f3-473d-9976-62f576de3902 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:45.959481 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2adbda94-81f3-473d-9976-62f576de3902 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:45.959911 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2adbda94-81f3-473d-9976-62f576de3902 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:45.960632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2adbda94-81f3-473d-9976-62f576de3902 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:45.961085 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2adbda94-81f3-473d-9976-62f576de3902 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:45.961504 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2adbda94-81f3-473d-9976-62f576de3902 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:46.114843 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2adbda94-81f3-473d-9976-62f576de3902 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:46.122532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2adbda94-81f3-473d-9976-62f576de3902 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1358 microversion: 2.1 time: 0.174759 Oct 27 09:39:46.123104 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 256/513] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:45 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:46.371305 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:46.371932 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:46.378308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:46.378776 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:46.379204 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:46.379876 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:46.380326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:46.380765 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:46.783148 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:46.791610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:46.793673 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:46.794831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f6026cc6-97f9-40ef-87c5-11aa978466e6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1752 microversion: 2.20 time: 0.427433 Oct 27 09:39:46.795388 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 258/514] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:46 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1752 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:47.145258 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2724ea77-2336-486d-84f7-1e272c4636ed tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:47.145910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2724ea77-2336-486d-84f7-1e272c4636ed tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:47.152890 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2724ea77-2336-486d-84f7-1e272c4636ed tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.153373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2724ea77-2336-486d-84f7-1e272c4636ed tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.153808 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2724ea77-2336-486d-84f7-1e272c4636ed tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.154504 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2724ea77-2336-486d-84f7-1e272c4636ed tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.155021 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2724ea77-2336-486d-84f7-1e272c4636ed tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.155434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2724ea77-2336-486d-84f7-1e272c4636ed tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.286282 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2724ea77-2336-486d-84f7-1e272c4636ed tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:47.293961 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2724ea77-2336-486d-84f7-1e272c4636ed tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1549 microversion: 2.1 time: 0.152501 Oct 27 09:39:47.294518 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 257/515] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:47 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:47.316849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5b76ac81-2cad-4ab0-8d95-fbac63de1777 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:47.317461 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5b76ac81-2cad-4ab0-8d95-fbac63de1777 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:47.323272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b76ac81-2cad-4ab0-8d95-fbac63de1777 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.323751 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b76ac81-2cad-4ab0-8d95-fbac63de1777 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.324180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b76ac81-2cad-4ab0-8d95-fbac63de1777 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.325501 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b76ac81-2cad-4ab0-8d95-fbac63de1777 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.325951 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b76ac81-2cad-4ab0-8d95-fbac63de1777 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.326368 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b76ac81-2cad-4ab0-8d95-fbac63de1777 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.450419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5b76ac81-2cad-4ab0-8d95-fbac63de1777 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:47.458413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5b76ac81-2cad-4ab0-8d95-fbac63de1777 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1549 microversion: 2.1 time: 0.145318 Oct 27 09:39:47.458980 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 259/516] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:47 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1549 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:47.479545 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:47.484561 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:47.485332 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Searching by: {'deleted': False, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8'} {{(pid=125362) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 09:39:47.491908 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.492388 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.492862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.493610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.494041 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.494470 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.584027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.multi_cell_list [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125362) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 09:39:47.680591 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8a15974b-a86c-4025-8791-e63f91542767 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204753 Oct 27 09:39:47.681448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 258/517] 10.222.0.70 () {58 vars in 1125 bytes} [Thu Oct 27 09:39:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:47.693707 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-659bfa1a-87f8-424e-8e88-60ff6a07268b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:47.694417 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-659bfa1a-87f8-424e-8e88-60ff6a07268b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:47.700352 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-659bfa1a-87f8-424e-8e88-60ff6a07268b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.700887 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-659bfa1a-87f8-424e-8e88-60ff6a07268b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.701317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-659bfa1a-87f8-424e-8e88-60ff6a07268b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.702003 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-659bfa1a-87f8-424e-8e88-60ff6a07268b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.702451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-659bfa1a-87f8-424e-8e88-60ff6a07268b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.703135 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-659bfa1a-87f8-424e-8e88-60ff6a07268b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.819293 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:47.819820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:47.826345 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.826828 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.827265 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.828220 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:47.828707 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:47.829116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:47.835448 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-659bfa1a-87f8-424e-8e88-60ff6a07268b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:47.843733 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-659bfa1a-87f8-424e-8e88-60ff6a07268b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1549 microversion: 2.1 time: 0.153787 Oct 27 09:39:47.844299 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 260/518] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:47 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:47.959352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:47.968373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:47.969826 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:47.970970 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0dfb949c-329a-429b-b722-acf5f0710a08 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1752 microversion: 2.20 time: 0.155732 Oct 27 09:39:47.971713 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 259/519] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:47 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:48.996410 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:48.997613 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:49.004107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:49.004618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:49.005052 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:49.005736 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:49.006189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:49.006606 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:49.137229 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:49.145640 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:49.147093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:49.148231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-aca80921-ab3d-4ba8-a6cf-c769d4b75b36 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1752 microversion: 2.20 time: 0.155725 Oct 27 09:39:49.148832 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 261/520] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:48 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:49.403562 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-939144c9-1cc8-4418-94e9-85ac13a8e966 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38d90438-fba9-48fb-813d-638ba347b4e5"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:49.405914 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-939144c9-1cc8-4418-94e9-85ac13a8e966 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:49.412374 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-939144c9-1cc8-4418-94e9-85ac13a8e966 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:49.412894 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-939144c9-1cc8-4418-94e9-85ac13a8e966 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:49.413327 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-939144c9-1cc8-4418-94e9-85ac13a8e966 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:49.414016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-939144c9-1cc8-4418-94e9-85ac13a8e966 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:49.414461 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-939144c9-1cc8-4418-94e9-85ac13a8e966 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:49.414899 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-939144c9-1cc8-4418-94e9-85ac13a8e966 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:49.747056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e69c8255-a1ca-4ae2-b43d-6e5b423b884c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: .version_select at 0x7f364932c940>, body: {"keypair": {"name": "tempest-keypair-2047436337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXYxvsqwsDGb7wdGJV2IdMABwJGBLPNk2j0YMajKJwgRJ/uFXO1sy3lYN2Q7yjEmZjoYkLhkX5o4XCoPGIyBs63Q2pByjq9b8HH0O/nYrjI17/dDhDVFWShyaxozKfoLg=="}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:49.753468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:49.764076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-e69c8255-a1ca-4ae2-b43d-6e5b423b884c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:39:49.767896 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-e69c8255-a1ca-4ae2-b43d-6e5b423b884c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for user f7d2c6275669404db608d714baeb0065 and project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:39:49.789662 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e69c8255-a1ca-4ae2-b43d-6e5b423b884c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046438 Oct 27 09:39:49.790257 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 262/521] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Oct 27 09:39:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:39:50.174048 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:50.174893 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:50.181550 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:50.182040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:50.182478 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:50.183179 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:50.183718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:50.197730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:50.422482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:50.431006 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:50.432452 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:50.433635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a86e3577-185c-435d-be88-8eac88bef5fb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1752 microversion: 2.20 time: 0.264258 Oct 27 09:39:50.434232 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 263/522] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:50 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1752 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:39:51.125741 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1863455271", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15104d09-0e0f-4140-ae39-9239f083d338"}], "security_groups": [{"name": "tempest-securitygroup--1588336898"}], "key_name": "tempest-keypair-2047436337", "user_data": "}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:51.226074 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.network.neutron [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] validate_networks() for [('15104d09-0e0f-4140-ae39-9239f083d338', None, None, None, None, None)] {{(pid=125361) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:39:51.595922 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Flavor limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:39:51.596349 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Image limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:39:51.596858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Flavor pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:39:51.597268 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Image pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:39:51.597677 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:39:51.606312 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.606793 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.607230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.607952 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.608409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.608867 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.626451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:39:51.630424 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for user f7d2c6275669404db608d714baeb0065 and project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:39:51.641849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Going to run 1 instances... {{(pid=125361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:39:51.644147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:39:51.676241 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-939144c9-1cc8-4418-94e9-85ac13a8e966 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "POST /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.276299 Oct 27 09:39:51.677619 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 260/523] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:39:49 2022] POST /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments => generated 194 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:39:51.682628 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:51.683560 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:51.690668 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.691167 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.691604 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.692305 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:51.692787 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:51.693220 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:51.706111 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b125a9b8-bae6-4f4c-a1b2-e41573b612cb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.584322 Oct 27 09:39:51.707285 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 264/524] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:39:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:39:51.719174 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-19d4ed7c-b4fa-4a46-b799-0f1c8980866b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:51.720237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-19d4ed7c-b4fa-4a46-b799-0f1c8980866b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:51.817589 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-19d4ed7c-b4fa-4a46-b799-0f1c8980866b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:51.826564 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-19d4ed7c-b4fa-4a46-b799-0f1c8980866b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1242 microversion: 2.1 time: 0.111942 Oct 27 09:39:51.827367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 265/525] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:51 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:51.878535 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:51.888630 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:51.890266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:51.891497 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2b634f8e-e113-4c08-9049-f1bb9f2a7734 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1752 microversion: 2.20 time: 0.212987 Oct 27 09:39:51.892053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 261/526] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:51 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:52.539586 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-381533854", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "networks": [{"uuid": "88875056-5d66-411a-8e40-f81cbf49fe49"}]}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:39:52.594574 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.network.neutron [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] validate_networks() for [('88875056-5d66-411a-8e40-f81cbf49fe49', None, None, None, None, None)] {{(pid=125361) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:39:52.853047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b5022f40-7676-469c-85fd-2a743fc5a488 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:52.853721 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b5022f40-7676-469c-85fd-2a743fc5a488 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:52.860346 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5022f40-7676-469c-85fd-2a743fc5a488 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:52.860861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5022f40-7676-469c-85fd-2a743fc5a488 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:52.861305 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5022f40-7676-469c-85fd-2a743fc5a488 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:52.862007 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5022f40-7676-469c-85fd-2a743fc5a488 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:52.862461 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5022f40-7676-469c-85fd-2a743fc5a488 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:52.862885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5022f40-7676-469c-85fd-2a743fc5a488 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:52.867275 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:53.017215 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b5022f40-7676-469c-85fd-2a743fc5a488 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:53.025910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b5022f40-7676-469c-85fd-2a743fc5a488 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1238 microversion: 2.1 time: 0.177985 Oct 27 09:39:53.026473 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 262/527] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:52 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1238 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:53.033307 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:53.033893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:53.040801 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:53.041386 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:53.041924 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:53.042456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Flavor limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:39:53.042879 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Image limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:39:53.043072 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:53.043697 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:53.044306 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:53.044991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Flavor pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:39:53.045409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Image pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:39:53.045826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:39:53.062944 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:53.063587 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:53.064215 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:53.065390 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:53.065971 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:53.066531 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:53.085047 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Getting quotas for project 9dc4fbf213f04cd7ab49abad693a1cf2. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:39:53.089103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Getting quotas for user b4e4e3b5ce544725b1f4a439596314a8 and project 9dc4fbf213f04cd7ab49abad693a1cf2. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:39:53.101259 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Going to run 1 instances... {{(pid=125361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:39:53.103532 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:39:53.154194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-fad2ee0c-ee63-4d50-b76a-153332a0c3f7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618342 Oct 27 09:39:53.154974 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 266/528] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:39:53.169577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8249bc0a-e5a8-4592-9c86-0aeb287ba060 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:53.170196 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8249bc0a-e5a8-4592-9c86-0aeb287ba060 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:53.279581 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-8249bc0a-e5a8-4592-9c86-0aeb287ba060 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:53.291670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8249bc0a-e5a8-4592-9c86-0aeb287ba060 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1218 microversion: 2.1 time: 0.125740 Oct 27 09:39:53.292624 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 267/529] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:53 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:53.307933 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:53.317811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:53.319428 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:53.320671 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-27352500-5d41-4eab-93e7-4b8c44ee4092 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.292835 Oct 27 09:39:53.324986 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 263/530] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:53 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:54.052555 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9ac8a792-db22-45a9-8be6-a9a7ecbb30f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:54.053106 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9ac8a792-db22-45a9-8be6-a9a7ecbb30f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:54.060009 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9ac8a792-db22-45a9-8be6-a9a7ecbb30f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.060486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9ac8a792-db22-45a9-8be6-a9a7ecbb30f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.060943 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9ac8a792-db22-45a9-8be6-a9a7ecbb30f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.061625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9ac8a792-db22-45a9-8be6-a9a7ecbb30f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.062080 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9ac8a792-db22-45a9-8be6-a9a7ecbb30f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.062499 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9ac8a792-db22-45a9-8be6-a9a7ecbb30f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.316740 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-244d255a-50c6-41e7-bf14-14e7ecf1b3c6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:54.317362 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-244d255a-50c6-41e7-bf14-14e7ecf1b3c6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:54.326036 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-244d255a-50c6-41e7-bf14-14e7ecf1b3c6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.326538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-244d255a-50c6-41e7-bf14-14e7ecf1b3c6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.326979 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-244d255a-50c6-41e7-bf14-14e7ecf1b3c6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.327960 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-244d255a-50c6-41e7-bf14-14e7ecf1b3c6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.328418 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-244d255a-50c6-41e7-bf14-14e7ecf1b3c6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.329244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-244d255a-50c6-41e7-bf14-14e7ecf1b3c6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.398923 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9ac8a792-db22-45a9-8be6-a9a7ecbb30f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:54.407257 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9ac8a792-db22-45a9-8be6-a9a7ecbb30f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1300 microversion: 2.1 time: 0.358568 Oct 27 09:39:54.407842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 268/531] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:54 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1300 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:54.425163 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:54.425781 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:54.431794 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.432307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.432781 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.433504 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:54.433958 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:54.434979 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:54.452019 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-244d255a-50c6-41e7-bf14-14e7ecf1b3c6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:54.462044 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-244d255a-50c6-41e7-bf14-14e7ecf1b3c6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1270 microversion: 2.1 time: 0.149197 Oct 27 09:39:54.463067 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 264/532] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:54 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:54.576563 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:54.585388 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:54.586890 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:54.588037 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6f5b8cd2-4e94-4145-808d-aaaffce12da9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.179120 Oct 27 09:39:54.588635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 269/533] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:54 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:55.435484 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1a5991f5-85d6-4a6e-90b3-70307a14ac35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:55.437003 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1a5991f5-85d6-4a6e-90b3-70307a14ac35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:55.448295 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a5991f5-85d6-4a6e-90b3-70307a14ac35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:55.449003 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a5991f5-85d6-4a6e-90b3-70307a14ac35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:55.449551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a5991f5-85d6-4a6e-90b3-70307a14ac35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:55.450481 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a5991f5-85d6-4a6e-90b3-70307a14ac35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:55.451041 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a5991f5-85d6-4a6e-90b3-70307a14ac35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:55.451574 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a5991f5-85d6-4a6e-90b3-70307a14ac35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:55.488059 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e0be866d-2748-41d8-8bd9-b4716c901e66 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:55.489516 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e0be866d-2748-41d8-8bd9-b4716c901e66 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:55.503916 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0be866d-2748-41d8-8bd9-b4716c901e66 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:55.506661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0be866d-2748-41d8-8bd9-b4716c901e66 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:55.507336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0be866d-2748-41d8-8bd9-b4716c901e66 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:55.508295 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0be866d-2748-41d8-8bd9-b4716c901e66 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:55.514062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0be866d-2748-41d8-8bd9-b4716c901e66 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:55.514062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0be866d-2748-41d8-8bd9-b4716c901e66 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:55.672733 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e0be866d-2748-41d8-8bd9-b4716c901e66 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:55.693035 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e0be866d-2748-41d8-8bd9-b4716c901e66 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1276 microversion: 2.1 time: 0.206460 Oct 27 09:39:55.697616 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 270/534] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:55 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1276 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:39:55.704443 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:55.705936 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:55.716952 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:55.717909 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:55.718029 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:55.719608 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:55.720188 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:55.720671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:55.850382 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1a5991f5-85d6-4a6e-90b3-70307a14ac35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:55.859263 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1a5991f5-85d6-4a6e-90b3-70307a14ac35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.428862 Oct 27 09:39:55.860239 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 265/535] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:55 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:55.999747 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:56.013962 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:56.015302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:56.016502 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-091889c9-6cdf-46f7-a0c4-2f6bebb9ebd3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.317587 Oct 27 09:39:56.017442 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 271/536] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:55 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:56.717491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c97497f8-984b-4b0f-8b84-470b7303d6b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:56.718090 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c97497f8-984b-4b0f-8b84-470b7303d6b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:56.724591 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c97497f8-984b-4b0f-8b84-470b7303d6b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:56.725074 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c97497f8-984b-4b0f-8b84-470b7303d6b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:56.725502 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c97497f8-984b-4b0f-8b84-470b7303d6b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:56.726193 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c97497f8-984b-4b0f-8b84-470b7303d6b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:56.726631 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c97497f8-984b-4b0f-8b84-470b7303d6b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:56.727047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c97497f8-984b-4b0f-8b84-470b7303d6b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:56.863957 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c97497f8-984b-4b0f-8b84-470b7303d6b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:56.872758 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c97497f8-984b-4b0f-8b84-470b7303d6b7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.158392 Oct 27 09:39:56.873355 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 266/537] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:56 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:56.889914 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e953e5e0-c2a3-4df6-a590-ba19ecc8c89c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:56.890641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e953e5e0-c2a3-4df6-a590-ba19ecc8c89c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:56.897363 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e953e5e0-c2a3-4df6-a590-ba19ecc8c89c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:56.897932 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e953e5e0-c2a3-4df6-a590-ba19ecc8c89c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:56.898436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e953e5e0-c2a3-4df6-a590-ba19ecc8c89c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:56.899208 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e953e5e0-c2a3-4df6-a590-ba19ecc8c89c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:56.899730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e953e5e0-c2a3-4df6-a590-ba19ecc8c89c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:56.900164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e953e5e0-c2a3-4df6-a590-ba19ecc8c89c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:57.038239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e953e5e0-c2a3-4df6-a590-ba19ecc8c89c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:57.044729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:57.045776 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:57.047930 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:57.053202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:57.059600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e953e5e0-c2a3-4df6-a590-ba19ecc8c89c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.173201 Oct 27 09:39:57.059779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 272/538] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:56 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:57.067274 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:57.067769 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:57.068548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:57.069020 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:57.069442 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:57.211589 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:57.221063 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:57.222498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:57.223650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-60726dc4-c289-45af-813d-c0a35f33c686 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.184093 Oct 27 09:39:57.224547 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 267/539] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:57 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:39:57.895794 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-16b272f3-ac41-420c-a2c3-1e2209ef3a4e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:57.896406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-16b272f3-ac41-420c-a2c3-1e2209ef3a4e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:57.902787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-16b272f3-ac41-420c-a2c3-1e2209ef3a4e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:57.903266 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-16b272f3-ac41-420c-a2c3-1e2209ef3a4e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:57.903696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-16b272f3-ac41-420c-a2c3-1e2209ef3a4e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:57.904392 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-16b272f3-ac41-420c-a2c3-1e2209ef3a4e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:57.904874 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-16b272f3-ac41-420c-a2c3-1e2209ef3a4e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:57.905297 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-16b272f3-ac41-420c-a2c3-1e2209ef3a4e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:58.052864 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-16b272f3-ac41-420c-a2c3-1e2209ef3a4e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:58.061151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-16b272f3-ac41-420c-a2c3-1e2209ef3a4e tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.169356 Oct 27 09:39:58.061704 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 273/540] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:57 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:58.084322 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e3763195-f2bc-4503-bd76-a0c2d19ef4f2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:58.085040 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e3763195-f2bc-4503-bd76-a0c2d19ef4f2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:58.086988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:39:58.092886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3763195-f2bc-4503-bd76-a0c2d19ef4f2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:58.093590 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3763195-f2bc-4503-bd76-a0c2d19ef4f2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:58.094191 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3763195-f2bc-4503-bd76-a0c2d19ef4f2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:58.094897 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3763195-f2bc-4503-bd76-a0c2d19ef4f2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:58.095341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3763195-f2bc-4503-bd76-a0c2d19ef4f2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:58.095758 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3763195-f2bc-4503-bd76-a0c2d19ef4f2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:58.242106 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e3763195-f2bc-4503-bd76-a0c2d19ef4f2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:58.250819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e3763195-f2bc-4503-bd76-a0c2d19ef4f2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.170244 Oct 27 09:39:58.251656 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 268/541] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:58 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:58.251788 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:58.252579 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:58.258680 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:58.259281 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:58.259823 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:58.260653 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:58.261212 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:58.261740 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:58.396914 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:58.405616 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:58.407059 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:58.408221 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f31e1ca9-5d9e-4921-ac73-cd3650414840 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.161238 Oct 27 09:39:58.408811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 274/542] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:58 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:39:59.084852 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-60aaa73d-1315-49b4-88a0-0f1494dfcb37 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:59.085544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-60aaa73d-1315-49b4-88a0-0f1494dfcb37 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:59.092239 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60aaa73d-1315-49b4-88a0-0f1494dfcb37 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:59.092752 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60aaa73d-1315-49b4-88a0-0f1494dfcb37 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:59.093189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60aaa73d-1315-49b4-88a0-0f1494dfcb37 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:59.093887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60aaa73d-1315-49b4-88a0-0f1494dfcb37 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:59.094341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60aaa73d-1315-49b4-88a0-0f1494dfcb37 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:59.094764 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-60aaa73d-1315-49b4-88a0-0f1494dfcb37 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:59.234106 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-60aaa73d-1315-49b4-88a0-0f1494dfcb37 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:59.242990 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-60aaa73d-1315-49b4-88a0-0f1494dfcb37 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.161927 Oct 27 09:39:59.243590 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 269/543] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:59 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:59.272821 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1f03bf99-973f-46b4-b4c4-45a0405f0e7c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:59.273433 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1f03bf99-973f-46b4-b4c4-45a0405f0e7c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:59.279774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f03bf99-973f-46b4-b4c4-45a0405f0e7c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:59.280255 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f03bf99-973f-46b4-b4c4-45a0405f0e7c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:59.280714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f03bf99-973f-46b4-b4c4-45a0405f0e7c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:59.281396 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f03bf99-973f-46b4-b4c4-45a0405f0e7c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:59.281843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f03bf99-973f-46b4-b4c4-45a0405f0e7c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:59.282258 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f03bf99-973f-46b4-b4c4-45a0405f0e7c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:59.423899 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1f03bf99-973f-46b4-b4c4-45a0405f0e7c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:59.431892 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1f03bf99-973f-46b4-b4c4-45a0405f0e7c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.162782 Oct 27 09:39:59.444545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 275/544] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:39:59 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:39:59.444779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:39:59.444779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:39:59.444779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:59.444779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:59.445140 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:59.446309 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:39:59.446776 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:39:59.447199 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:39:59.583587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:59.592640 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:59.594218 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:39:59.595484 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-bb47f385-1dcb-46ca-85e9-b1ca03336ba5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.165742 Oct 27 09:39:59.596165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 270/545] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:39:59 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:40:00.265771 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ddab64c3-3052-4c72-8307-c1e0f264c079 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:00.266388 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ddab64c3-3052-4c72-8307-c1e0f264c079 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:00.273158 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ddab64c3-3052-4c72-8307-c1e0f264c079 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:00.274357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ddab64c3-3052-4c72-8307-c1e0f264c079 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:00.274960 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ddab64c3-3052-4c72-8307-c1e0f264c079 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:00.275846 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ddab64c3-3052-4c72-8307-c1e0f264c079 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:00.276456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ddab64c3-3052-4c72-8307-c1e0f264c079 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:00.277072 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ddab64c3-3052-4c72-8307-c1e0f264c079 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:00.409299 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ddab64c3-3052-4c72-8307-c1e0f264c079 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:00.417174 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ddab64c3-3052-4c72-8307-c1e0f264c079 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.155211 Oct 27 09:40:00.417607 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 276/546] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:00 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:00.455361 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-502682d0-4f74-4ebe-8613-f885fbe3ab25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:00.455966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-502682d0-4f74-4ebe-8613-f885fbe3ab25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:00.462549 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-502682d0-4f74-4ebe-8613-f885fbe3ab25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:00.463064 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-502682d0-4f74-4ebe-8613-f885fbe3ab25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:00.463501 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-502682d0-4f74-4ebe-8613-f885fbe3ab25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:00.464273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-502682d0-4f74-4ebe-8613-f885fbe3ab25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:00.464777 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-502682d0-4f74-4ebe-8613-f885fbe3ab25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:00.465202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-502682d0-4f74-4ebe-8613-f885fbe3ab25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:00.603422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-502682d0-4f74-4ebe-8613-f885fbe3ab25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:00.611262 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-502682d0-4f74-4ebe-8613-f885fbe3ab25 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.159948 Oct 27 09:40:00.611835 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 271/547] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:00 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:00.620401 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:00.621131 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:00.627250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:00.628961 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:00.629432 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:00.630160 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:00.630625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:00.631055 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:00.635391 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:00.772202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:00.781652 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:00.783079 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:00.784228 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3178047b-c1c6-4f35-844d-cd0a2f62d9ea tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.167703 Oct 27 09:40:00.784827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 277/548] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:00 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:40:01.439146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-dba118fe-7865-4f8e-b40b-6ddcf603b02b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:01.439805 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-dba118fe-7865-4f8e-b40b-6ddcf603b02b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:01.446327 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dba118fe-7865-4f8e-b40b-6ddcf603b02b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:01.446812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dba118fe-7865-4f8e-b40b-6ddcf603b02b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:01.447243 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dba118fe-7865-4f8e-b40b-6ddcf603b02b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:01.447934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dba118fe-7865-4f8e-b40b-6ddcf603b02b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:01.448386 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dba118fe-7865-4f8e-b40b-6ddcf603b02b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:01.448843 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dba118fe-7865-4f8e-b40b-6ddcf603b02b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:01.586151 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-dba118fe-7865-4f8e-b40b-6ddcf603b02b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:01.599477 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-dba118fe-7865-4f8e-b40b-6ddcf603b02b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.164109 Oct 27 09:40:01.603149 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 272/549] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:01 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:01.635133 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-10486d20-6ba7-47a6-8e77-82305c2c8a4c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:01.635731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-10486d20-6ba7-47a6-8e77-82305c2c8a4c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:01.642836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10486d20-6ba7-47a6-8e77-82305c2c8a4c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:01.643328 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10486d20-6ba7-47a6-8e77-82305c2c8a4c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:01.643735 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10486d20-6ba7-47a6-8e77-82305c2c8a4c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:01.644421 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10486d20-6ba7-47a6-8e77-82305c2c8a4c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:01.649049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10486d20-6ba7-47a6-8e77-82305c2c8a4c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:01.649504 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-10486d20-6ba7-47a6-8e77-82305c2c8a4c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:01.785666 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-10486d20-6ba7-47a6-8e77-82305c2c8a4c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:01.793210 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-10486d20-6ba7-47a6-8e77-82305c2c8a4c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.161959 Oct 27 09:40:01.793767 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 278/550] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:01 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:01.812690 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:01.813703 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:01.820178 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:01.821028 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:01.821634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:01.822636 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:01.823240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:01.823831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:01.970072 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:01.978909 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:01.980657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:01.981832 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e94977ac-e242-4b37-a2fc-3af755f52157 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.175566 Oct 27 09:40:01.982390 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 273/551] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:01 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:40:02.622227 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5d41b496-12cc-4af8-b34f-aee4ad556bd7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:02.623000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5d41b496-12cc-4af8-b34f-aee4ad556bd7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:02.629233 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5d41b496-12cc-4af8-b34f-aee4ad556bd7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:02.629752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5d41b496-12cc-4af8-b34f-aee4ad556bd7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:02.630186 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5d41b496-12cc-4af8-b34f-aee4ad556bd7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:02.630882 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5d41b496-12cc-4af8-b34f-aee4ad556bd7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:02.631338 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5d41b496-12cc-4af8-b34f-aee4ad556bd7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:02.631764 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5d41b496-12cc-4af8-b34f-aee4ad556bd7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:02.767845 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5d41b496-12cc-4af8-b34f-aee4ad556bd7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:02.775723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5d41b496-12cc-4af8-b34f-aee4ad556bd7 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.157291 Oct 27 09:40:02.776307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 279/552] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:02 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:02.816374 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f1e479ce-b224-4e43-b859-f61c4302c1db tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:02.817006 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f1e479ce-b224-4e43-b859-f61c4302c1db tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:02.823428 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1e479ce-b224-4e43-b859-f61c4302c1db tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:02.823910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1e479ce-b224-4e43-b859-f61c4302c1db tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:02.824340 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1e479ce-b224-4e43-b859-f61c4302c1db tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:02.825059 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1e479ce-b224-4e43-b859-f61c4302c1db tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:02.825503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1e479ce-b224-4e43-b859-f61c4302c1db tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:02.825924 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f1e479ce-b224-4e43-b859-f61c4302c1db tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:02.960510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f1e479ce-b224-4e43-b859-f61c4302c1db tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:02.969325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f1e479ce-b224-4e43-b859-f61c4302c1db tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.156558 Oct 27 09:40:02.969839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 274/553] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:02 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:03.010561 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:03.011305 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:03.018019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:03.018547 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:03.018991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:03.019697 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:03.020149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:03.020598 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:03.075238 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=4 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:03.174660 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:03.183668 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:03.186055 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:03.186327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3fad9c93-5e70-417f-9669-722263cedca6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.179719 Oct 27 09:40:03.186885 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 280/554] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:03 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:40:03.799679 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-15eeceac-e0ff-42e0-8635-9acae944f862 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:03.800229 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-15eeceac-e0ff-42e0-8635-9acae944f862 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:03.806633 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-15eeceac-e0ff-42e0-8635-9acae944f862 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:03.807127 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-15eeceac-e0ff-42e0-8635-9acae944f862 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:03.807565 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-15eeceac-e0ff-42e0-8635-9acae944f862 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:03.808423 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-15eeceac-e0ff-42e0-8635-9acae944f862 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:03.808921 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-15eeceac-e0ff-42e0-8635-9acae944f862 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:03.809355 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-15eeceac-e0ff-42e0-8635-9acae944f862 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:03.948094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-15eeceac-e0ff-42e0-8635-9acae944f862 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:03.956209 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-15eeceac-e0ff-42e0-8635-9acae944f862 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.161294 Oct 27 09:40:03.956809 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 275/555] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:03 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:03.992783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d7c82f7a-1008-4d28-93e8-9ec78225ef87 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:03.993541 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d7c82f7a-1008-4d28-93e8-9ec78225ef87 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:03.995585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=20 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:04.002824 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d7c82f7a-1008-4d28-93e8-9ec78225ef87 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:04.003304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d7c82f7a-1008-4d28-93e8-9ec78225ef87 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:04.003738 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d7c82f7a-1008-4d28-93e8-9ec78225ef87 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:04.004430 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d7c82f7a-1008-4d28-93e8-9ec78225ef87 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:04.004929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d7c82f7a-1008-4d28-93e8-9ec78225ef87 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:04.005353 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d7c82f7a-1008-4d28-93e8-9ec78225ef87 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:04.144080 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d7c82f7a-1008-4d28-93e8-9ec78225ef87 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:04.151694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d7c82f7a-1008-4d28-93e8-9ec78225ef87 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.163590 Oct 27 09:40:04.152260 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 281/556] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:03 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:04.212229 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:04.212870 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:04.218963 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:04.219597 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:04.220037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:04.220764 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:04.221215 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:04.222245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:04.361736 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:04.370788 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:04.372347 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:04.373620 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6ba45f59-ffd8-4574-9a65-1404653d514d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.165291 Oct 27 09:40:04.374830 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 276/557] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:04 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:40:04.979280 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-589a5f84-303c-4768-9a37-54f88434b51d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:04.979896 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-589a5f84-303c-4768-9a37-54f88434b51d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:04.986773 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-589a5f84-303c-4768-9a37-54f88434b51d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:04.987262 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-589a5f84-303c-4768-9a37-54f88434b51d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:04.987693 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-589a5f84-303c-4768-9a37-54f88434b51d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:04.988389 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-589a5f84-303c-4768-9a37-54f88434b51d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:04.988971 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-589a5f84-303c-4768-9a37-54f88434b51d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:04.989406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-589a5f84-303c-4768-9a37-54f88434b51d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:05.122941 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-589a5f84-303c-4768-9a37-54f88434b51d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:05.131403 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-589a5f84-303c-4768-9a37-54f88434b51d tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.156022 Oct 27 09:40:05.131979 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 282/558] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:04 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:05.175031 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7d478184-dcd3-4fc0-b1b1-607ec6cd9567 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:05.175803 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7d478184-dcd3-4fc0-b1b1-607ec6cd9567 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:05.182335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d478184-dcd3-4fc0-b1b1-607ec6cd9567 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:05.182825 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d478184-dcd3-4fc0-b1b1-607ec6cd9567 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:05.183261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d478184-dcd3-4fc0-b1b1-607ec6cd9567 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:05.183969 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d478184-dcd3-4fc0-b1b1-607ec6cd9567 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:05.184423 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d478184-dcd3-4fc0-b1b1-607ec6cd9567 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:05.184880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d478184-dcd3-4fc0-b1b1-607ec6cd9567 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:05.322152 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7d478184-dcd3-4fc0-b1b1-607ec6cd9567 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:05.330464 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7d478184-dcd3-4fc0-b1b1-607ec6cd9567 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.159777 Oct 27 09:40:05.331045 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 277/559] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:05 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:05.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:05.401436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:05.408578 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:05.409073 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:05.409507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:05.410206 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:05.410663 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:05.411088 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:05.543304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:05.552577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:05.554213 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:05.555391 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7d771e38-56aa-4b7f-93dc-e17544cb6923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.158967 Oct 27 09:40:05.556049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 283/560] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:05 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:40:06.154545 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-96b8757a-8fce-4439-b06b-d136ff19910a tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:06.155153 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-96b8757a-8fce-4439-b06b-d136ff19910a tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:06.161102 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-96b8757a-8fce-4439-b06b-d136ff19910a tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:06.161582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-96b8757a-8fce-4439-b06b-d136ff19910a tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:06.162016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-96b8757a-8fce-4439-b06b-d136ff19910a tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:06.162697 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-96b8757a-8fce-4439-b06b-d136ff19910a tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:06.163146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-96b8757a-8fce-4439-b06b-d136ff19910a tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:06.163564 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-96b8757a-8fce-4439-b06b-d136ff19910a tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:06.294979 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-96b8757a-8fce-4439-b06b-d136ff19910a tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:06.298515 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:06.303582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-96b8757a-8fce-4439-b06b-d136ff19910a tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.152913 Oct 27 09:40:06.304146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 278/561] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:06 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:06.353773 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8c37adb6-6fba-4bda-9ec0-3a4588ed17e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:06.354390 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8c37adb6-6fba-4bda-9ec0-3a4588ed17e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:06.360820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8c37adb6-6fba-4bda-9ec0-3a4588ed17e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:06.361302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8c37adb6-6fba-4bda-9ec0-3a4588ed17e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:06.361737 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8c37adb6-6fba-4bda-9ec0-3a4588ed17e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:06.362420 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8c37adb6-6fba-4bda-9ec0-3a4588ed17e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:06.362878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8c37adb6-6fba-4bda-9ec0-3a4588ed17e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:06.363297 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8c37adb6-6fba-4bda-9ec0-3a4588ed17e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:06.493103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-8c37adb6-6fba-4bda-9ec0-3a4588ed17e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:06.500823 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8c37adb6-6fba-4bda-9ec0-3a4588ed17e2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.150847 Oct 27 09:40:06.501393 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 284/562] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:06 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:06.582349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:06.582948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:06.588904 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:06.589388 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:06.589825 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:06.590516 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:06.590966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:06.591383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:06.931855 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:06.941166 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:06.942601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:06.943748 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7ac323f0-421b-4fab-9ac3-26ce5196e5c0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.365544 Oct 27 09:40:06.944312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 279/563] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:06 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:40:07.326760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-37bdcb07-f518-4a9a-9b1c-66266a5118fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:07.328102 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-37bdcb07-f518-4a9a-9b1c-66266a5118fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:07.334176 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-37bdcb07-f518-4a9a-9b1c-66266a5118fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:07.334650 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-37bdcb07-f518-4a9a-9b1c-66266a5118fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:07.335076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-37bdcb07-f518-4a9a-9b1c-66266a5118fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:07.335805 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-37bdcb07-f518-4a9a-9b1c-66266a5118fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:07.336251 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-37bdcb07-f518-4a9a-9b1c-66266a5118fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:07.336706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-37bdcb07-f518-4a9a-9b1c-66266a5118fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:07.524833 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0148482f-33d4-444c-93cc-bf7dedb64fd3 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:07.525587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0148482f-33d4-444c-93cc-bf7dedb64fd3 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:07.532776 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0148482f-33d4-444c-93cc-bf7dedb64fd3 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:07.533262 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0148482f-33d4-444c-93cc-bf7dedb64fd3 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:07.533697 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0148482f-33d4-444c-93cc-bf7dedb64fd3 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:07.534433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0148482f-33d4-444c-93cc-bf7dedb64fd3 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:07.534878 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0148482f-33d4-444c-93cc-bf7dedb64fd3 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:07.535302 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0148482f-33d4-444c-93cc-bf7dedb64fd3 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:07.653335 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-37bdcb07-f518-4a9a-9b1c-66266a5118fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:07.661351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-37bdcb07-f518-4a9a-9b1c-66266a5118fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.338373 Oct 27 09:40:07.661931 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 285/564] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:07 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:07.971331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:07.971884 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:07.978157 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:07.978641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:07.979076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:07.980056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:07.980446 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:07.980889 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:08.036861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0148482f-33d4-444c-93cc-bf7dedb64fd3 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:08.045383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0148482f-33d4-444c-93cc-bf7dedb64fd3 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.524301 Oct 27 09:40:08.051008 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 280/565] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:07 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:08.204115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-f27277e5-b790-4593-8a67-a693fc9e3154 req-7157c35e-eee3-465a-bb01-0a617bc0af6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0757d24a-7369-4583-8b26-85d48e0ba6cf", "tag": "679f3124-ba7d-4f06-8f2b-63d51480c3ff"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:08.213588 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-f27277e5-b790-4593-8a67-a693fc9e3154 req-7157c35e-eee3-465a-bb01-0a617bc0af6c service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:08.214061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-f27277e5-b790-4593-8a67-a693fc9e3154 req-7157c35e-eee3-465a-bb01-0a617bc0af6c service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:08.214484 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-f27277e5-b790-4593-8a67-a693fc9e3154 req-7157c35e-eee3-465a-bb01-0a617bc0af6c service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:08.225212 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-f27277e5-b790-4593-8a67-a693fc9e3154 req-7157c35e-eee3-465a-bb01-0a617bc0af6c service nova] Creating event network-changed:679f3124-ba7d-4f06-8f2b-63d51480c3ff for instance 0757d24a-7369-4583-8b26-85d48e0ba6cf on hv-cinder-79797 Oct 27 09:40:08.230091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-f27277e5-b790-4593-8a67-a693fc9e3154 req-7157c35e-eee3-465a-bb01-0a617bc0af6c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029898 Oct 27 09:40:08.230683 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 281/566] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:40:08.275517 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:08.287802 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:08.289271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:08.290439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a090a0cb-2b26-451d-828c-ba569a6e85c6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.323628 Oct 27 09:40:08.290994 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 286/567] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:07 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:40:08.684246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9d9d7be0-7e58-42a7-badc-65387169d7d9 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:08.684984 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9d9d7be0-7e58-42a7-badc-65387169d7d9 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:08.691186 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9d9d7be0-7e58-42a7-badc-65387169d7d9 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:08.691679 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9d9d7be0-7e58-42a7-badc-65387169d7d9 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:08.692115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9d9d7be0-7e58-42a7-badc-65387169d7d9 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:08.692833 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9d9d7be0-7e58-42a7-badc-65387169d7d9 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:08.693291 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9d9d7be0-7e58-42a7-badc-65387169d7d9 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:08.693717 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9d9d7be0-7e58-42a7-badc-65387169d7d9 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:08.822634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9d9d7be0-7e58-42a7-badc-65387169d7d9 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:08.830788 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9d9d7be0-7e58-42a7-badc-65387169d7d9 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.151280 Oct 27 09:40:08.831352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 282/568] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:08 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:09.074229 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3d516104-9c6d-4bf5-86f7-48d44ed33dfd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:09.075589 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3d516104-9c6d-4bf5-86f7-48d44ed33dfd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:09.082450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3d516104-9c6d-4bf5-86f7-48d44ed33dfd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:09.082940 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3d516104-9c6d-4bf5-86f7-48d44ed33dfd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:09.083374 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3d516104-9c6d-4bf5-86f7-48d44ed33dfd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:09.084077 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3d516104-9c6d-4bf5-86f7-48d44ed33dfd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:09.084542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3d516104-9c6d-4bf5-86f7-48d44ed33dfd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:09.085309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3d516104-9c6d-4bf5-86f7-48d44ed33dfd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:09.315898 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:09.316535 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:09.322476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:09.322958 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:09.323392 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:09.324082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:09.324664 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:09.325090 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:09.416756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3d516104-9c6d-4bf5-86f7-48d44ed33dfd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:09.424487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3d516104-9c6d-4bf5-86f7-48d44ed33dfd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.354374 Oct 27 09:40:09.425191 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 287/569] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:09 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:09.599761 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:09.608368 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:09.609935 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:09.611378 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2d48f6a0-2fa0-46e2-adce-a539d99e35d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.299988 Oct 27 09:40:09.611948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 283/570] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:09 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:40:09.853879 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a7db5a31-65e4-47f5-88b1-aa2388a2bb44 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:09.854494 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a7db5a31-65e4-47f5-88b1-aa2388a2bb44 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:09.860349 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a7db5a31-65e4-47f5-88b1-aa2388a2bb44 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:09.860874 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a7db5a31-65e4-47f5-88b1-aa2388a2bb44 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:09.861308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a7db5a31-65e4-47f5-88b1-aa2388a2bb44 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:09.861997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a7db5a31-65e4-47f5-88b1-aa2388a2bb44 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:09.862445 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a7db5a31-65e4-47f5-88b1-aa2388a2bb44 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:09.862866 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a7db5a31-65e4-47f5-88b1-aa2388a2bb44 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:09.991131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2d9d6ff7-981d-48a5-abf0-1846b80d4e8f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:09.992015 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2d9d6ff7-981d-48a5-abf0-1846b80d4e8f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:09.994403 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a7db5a31-65e4-47f5-88b1-aa2388a2bb44 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:09.999428 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d9d6ff7-981d-48a5-abf0-1846b80d4e8f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:09.999990 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d9d6ff7-981d-48a5-abf0-1846b80d4e8f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.000546 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d9d6ff7-981d-48a5-abf0-1846b80d4e8f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.001260 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d9d6ff7-981d-48a5-abf0-1846b80d4e8f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.001743 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d9d6ff7-981d-48a5-abf0-1846b80d4e8f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.002189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2d9d6ff7-981d-48a5-abf0-1846b80d4e8f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.002692 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a7db5a31-65e4-47f5-88b1-aa2388a2bb44 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.152802 Oct 27 09:40:10.003269 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 288/571] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:09 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:10.127305 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2d9d6ff7-981d-48a5-abf0-1846b80d4e8f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:10.135336 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2d9d6ff7-981d-48a5-abf0-1846b80d4e8f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1595 microversion: 2.1 time: 0.148117 Oct 27 09:40:10.135895 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 284/572] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:09 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1595 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:10.249757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-d4522a01-1936-4258-bc5f-83761bfcba44 req-588db268-1049-4626-b5ad-b939451d2942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7372b52-0f50-4517-840c-c97081a05995", "tag": "d2dc3936-eb1d-4275-8a23-06d264b2ba89"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:10.259176 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-d4522a01-1936-4258-bc5f-83761bfcba44 req-588db268-1049-4626-b5ad-b939451d2942 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.259655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-d4522a01-1936-4258-bc5f-83761bfcba44 req-588db268-1049-4626-b5ad-b939451d2942 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.260081 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-d4522a01-1936-4258-bc5f-83761bfcba44 req-588db268-1049-4626-b5ad-b939451d2942 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.277063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-d4522a01-1936-4258-bc5f-83761bfcba44 req-588db268-1049-4626-b5ad-b939451d2942 service nova] Creating event network-changed:d2dc3936-eb1d-4275-8a23-06d264b2ba89 for instance f7372b52-0f50-4517-840c-c97081a05995 on hv-cinder-79797 Oct 27 09:40:10.282233 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-d4522a01-1936-4258-bc5f-83761bfcba44 req-588db268-1049-4626-b5ad-b939451d2942 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037036 Oct 27 09:40:10.283096 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 289/573] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:10.447413 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a8906fc0-3d71-434c-bc05-5a28c503ed35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:10.448027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a8906fc0-3d71-434c-bc05-5a28c503ed35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:10.454198 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a8906fc0-3d71-434c-bc05-5a28c503ed35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.454680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a8906fc0-3d71-434c-bc05-5a28c503ed35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.455114 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a8906fc0-3d71-434c-bc05-5a28c503ed35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.455811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a8906fc0-3d71-434c-bc05-5a28c503ed35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.456264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a8906fc0-3d71-434c-bc05-5a28c503ed35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.456727 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a8906fc0-3d71-434c-bc05-5a28c503ed35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.638096 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:10.638923 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:10.642705 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:10.646727 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.647211 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.647637 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.648322 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:10.648817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:10.649232 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:10.659349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a8906fc0-3d71-434c-bc05-5a28c503ed35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:10.668246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a8906fc0-3d71-434c-bc05-5a28c503ed35 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.224714 Oct 27 09:40:10.669350 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 285/574] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:10 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:10.986201 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:10.994871 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:10.996323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:10.997520 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-546438b1-94cb-4802-aed9-4b0447ee8e90 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.363806 Oct 27 09:40:10.998081 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 290/575] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:10 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:40:11.025472 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-90b14948-f55e-4d7e-b576-2c3b080f91d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:11.026084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-90b14948-f55e-4d7e-b576-2c3b080f91d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:11.033312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-90b14948-f55e-4d7e-b576-2c3b080f91d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:11.034148 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-90b14948-f55e-4d7e-b576-2c3b080f91d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:11.034634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-90b14948-f55e-4d7e-b576-2c3b080f91d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:11.035622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-90b14948-f55e-4d7e-b576-2c3b080f91d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:11.036282 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-90b14948-f55e-4d7e-b576-2c3b080f91d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:11.037074 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-90b14948-f55e-4d7e-b576-2c3b080f91d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:11.696745 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-47e2f9a1-7b45-4467-833c-3f0da6d5fb80 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:11.697799 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-47e2f9a1-7b45-4467-833c-3f0da6d5fb80 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:11.704485 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-47e2f9a1-7b45-4467-833c-3f0da6d5fb80 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:11.705078 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-47e2f9a1-7b45-4467-833c-3f0da6d5fb80 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:11.705580 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-47e2f9a1-7b45-4467-833c-3f0da6d5fb80 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:11.706347 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-47e2f9a1-7b45-4467-833c-3f0da6d5fb80 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:11.706893 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-47e2f9a1-7b45-4467-833c-3f0da6d5fb80 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:11.707388 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-47e2f9a1-7b45-4467-833c-3f0da6d5fb80 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:11.726180 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-90b14948-f55e-4d7e-b576-2c3b080f91d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:11.738837 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-90b14948-f55e-4d7e-b576-2c3b080f91d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.716515 Oct 27 09:40:11.739821 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 286/576] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:11 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:11.926195 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-47e2f9a1-7b45-4467-833c-3f0da6d5fb80 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:11.933813 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-47e2f9a1-7b45-4467-833c-3f0da6d5fb80 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.242279 Oct 27 09:40:11.934398 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 291/577] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:11 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:12.023458 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:12.024183 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:12.032822 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:12.033443 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:12.034018 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:12.035312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:12.036457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:12.037148 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:12.264143 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:12.278851 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:12.280841 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:12.282217 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-52d81b3e-e653-4aa7-89c4-f9608790a2d4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.262707 Oct 27 09:40:12.282944 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 287/578] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:12 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:40:12.746770 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-69c3118d-91fb-4d28-b9f6-e11ae1cdb041 req-a4783301-e25e-4701-abd2-a734f9cee970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc27f94-5b44-482f-9d13-b102e27b7a10", "tag": "7969c643-a189-494b-ab3e-877a44420350"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:12.756984 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-69c3118d-91fb-4d28-b9f6-e11ae1cdb041 req-a4783301-e25e-4701-abd2-a734f9cee970 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:12.757799 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-69c3118d-91fb-4d28-b9f6-e11ae1cdb041 req-a4783301-e25e-4701-abd2-a734f9cee970 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:12.758440 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-69c3118d-91fb-4d28-b9f6-e11ae1cdb041 req-a4783301-e25e-4701-abd2-a734f9cee970 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:12.763320 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-29b57208-a303-46da-bd54-8409527977fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:12.767814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-29b57208-a303-46da-bd54-8409527977fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:12.772337 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-69c3118d-91fb-4d28-b9f6-e11ae1cdb041 req-a4783301-e25e-4701-abd2-a734f9cee970 service nova] Creating event network-changed:7969c643-a189-494b-ab3e-877a44420350 for instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 on hv-cinder-79797 Oct 27 09:40:12.775468 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29b57208-a303-46da-bd54-8409527977fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:12.775944 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29b57208-a303-46da-bd54-8409527977fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:12.776382 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29b57208-a303-46da-bd54-8409527977fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:12.777102 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29b57208-a303-46da-bd54-8409527977fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:12.777549 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29b57208-a303-46da-bd54-8409527977fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:12.777966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-29b57208-a303-46da-bd54-8409527977fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:12.778080 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-69c3118d-91fb-4d28-b9f6-e11ae1cdb041 req-a4783301-e25e-4701-abd2-a734f9cee970 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035000 Oct 27 09:40:12.778866 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 292/579] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:12.949948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-29b57208-a303-46da-bd54-8409527977fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:12.959127 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-29b57208-a303-46da-bd54-8409527977fd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.200425 Oct 27 09:40:12.960741 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ff5bb095-6dc8-4ae6-a2a7-9e22110f2352 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:12.962197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ff5bb095-6dc8-4ae6-a2a7-9e22110f2352 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:12.973320 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 288/580] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:12 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:12.973906 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5bb095-6dc8-4ae6-a2a7-9e22110f2352 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:12.974568 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5bb095-6dc8-4ae6-a2a7-9e22110f2352 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:12.975156 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5bb095-6dc8-4ae6-a2a7-9e22110f2352 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:12.976098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5bb095-6dc8-4ae6-a2a7-9e22110f2352 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:12.976793 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5bb095-6dc8-4ae6-a2a7-9e22110f2352 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:12.977421 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5bb095-6dc8-4ae6-a2a7-9e22110f2352 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:13.310252 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:13.311154 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:13.322394 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:13.323158 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:13.323820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:13.326923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:13.326923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:13.326923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:13.343304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ff5bb095-6dc8-4ae6-a2a7-9e22110f2352 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:13.361963 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ff5bb095-6dc8-4ae6-a2a7-9e22110f2352 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.407370 Oct 27 09:40:13.362912 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 293/581] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:12 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:13.627589 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:13.638486 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:13.641524 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:13.642853 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-079fec96-7cff-4f44-b258-ced51b8c64c5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.338903 Oct 27 09:40:13.643494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 289/582] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:13 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:40:13.984608 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f53ec78c-af5b-43cd-934e-0ed0f84849cd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:13.987066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-f60016ab-6538-408a-8c05-3ba2617614d2 req-5483db6b-f683-4105-9ea5-fe4446ce7fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac6a130-38c4-4843-b9a8-118d25c11c18", "name": "network-vif-plugged", "status": "completed", "tag": "0e6b0478-48aa-4f67-86d8-eb4b392e3971"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:13.988254 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f53ec78c-af5b-43cd-934e-0ed0f84849cd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:14.001641 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f53ec78c-af5b-43cd-934e-0ed0f84849cd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.003176 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f53ec78c-af5b-43cd-934e-0ed0f84849cd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.005028 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f53ec78c-af5b-43cd-934e-0ed0f84849cd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.005955 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f53ec78c-af5b-43cd-934e-0ed0f84849cd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.008738 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-f60016ab-6538-408a-8c05-3ba2617614d2 req-5483db6b-f683-4105-9ea5-fe4446ce7fbc service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.009738 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f53ec78c-af5b-43cd-934e-0ed0f84849cd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.010493 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f53ec78c-af5b-43cd-934e-0ed0f84849cd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.012729 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-f60016ab-6538-408a-8c05-3ba2617614d2 req-5483db6b-f683-4105-9ea5-fe4446ce7fbc service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.016429 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-f60016ab-6538-408a-8c05-3ba2617614d2 req-5483db6b-f683-4105-9ea5-fe4446ce7fbc service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.060389 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-f60016ab-6538-408a-8c05-3ba2617614d2 req-5483db6b-f683-4105-9ea5-fe4446ce7fbc service nova] Creating event network-vif-plugged:0e6b0478-48aa-4f67-86d8-eb4b392e3971 for instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 on hv-cinder-79797 Oct 27 09:40:14.088423 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-f60016ab-6538-408a-8c05-3ba2617614d2 req-5483db6b-f683-4105-9ea5-fe4446ce7fbc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101636 Oct 27 09:40:14.089738 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 294/583] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:14.106185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e0367736-abaf-4e3b-8304-5bb4c74f870c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:14.106990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e0367736-abaf-4e3b-8304-5bb4c74f870c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:14.124580 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0367736-abaf-4e3b-8304-5bb4c74f870c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.125519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0367736-abaf-4e3b-8304-5bb4c74f870c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.126133 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0367736-abaf-4e3b-8304-5bb4c74f870c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.127723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0367736-abaf-4e3b-8304-5bb4c74f870c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.128357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0367736-abaf-4e3b-8304-5bb4c74f870c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.129013 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e0367736-abaf-4e3b-8304-5bb4c74f870c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.237380 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:14.241975 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-e0367736-abaf-4e3b-8304-5bb4c74f870c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'services' on Instance uuid 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:40:14.246397 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f53ec78c-af5b-43cd-934e-0ed0f84849cd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:14.255377 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f53ec78c-af5b-43cd-934e-0ed0f84849cd tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.275789 Oct 27 09:40:14.260942 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 290/584] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:13 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:14.267370 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-54275745-8ace-49d6-8754-d434f64748f9 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1003713580"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:14.268110 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-54275745-8ace-49d6-8754-d434f64748f9 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:14.274788 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54275745-8ace-49d6-8754-d434f64748f9 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.275358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54275745-8ace-49d6-8754-d434f64748f9 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.275801 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54275745-8ace-49d6-8754-d434f64748f9 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.276503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54275745-8ace-49d6-8754-d434f64748f9 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.277024 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54275745-8ace-49d6-8754-d434f64748f9 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.277446 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-54275745-8ace-49d6-8754-d434f64748f9 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.323194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e0367736-abaf-4e3b-8304-5bb4c74f870c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/os-volume_attachments/2c6b0003-9ad7-45fb-b382-8bb76ad28d60" status: 202 len: 0 microversion: 2.1 time: 0.231665 Oct 27 09:40:14.323792 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 295/585] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:40:14 2022] DELETE /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/os-volume_attachments/2c6b0003-9ad7-45fb-b382-8bb76ad28d60 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:40:14.385501 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ca1d42fe-3b9e-4198-bf4d-d2f91ba589fd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:14.386227 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ca1d42fe-3b9e-4198-bf4d-d2f91ba589fd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:14.392504 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1d42fe-3b9e-4198-bf4d-d2f91ba589fd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.393021 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1d42fe-3b9e-4198-bf4d-d2f91ba589fd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.393457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1d42fe-3b9e-4198-bf4d-d2f91ba589fd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.394139 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1d42fe-3b9e-4198-bf4d-d2f91ba589fd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.394586 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1d42fe-3b9e-4198-bf4d-d2f91ba589fd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.395004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca1d42fe-3b9e-4198-bf4d-d2f91ba589fd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.410870 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.network.security_group_api [None req-54275745-8ace-49d6-8754-d434f64748f9 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Adding security group b10bb2b0-1160-463d-b173-84e4e57babba to port 7969c643-a189-494b-ab3e-877a44420350 Oct 27 09:40:14.607419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ca1d42fe-3b9e-4198-bf4d-d2f91ba589fd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:14.620652 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ca1d42fe-3b9e-4198-bf4d-d2f91ba589fd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.238625 Oct 27 09:40:14.622307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 296/586] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:14 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:14.674171 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:14.674783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:14.680729 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.681451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.681893 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:14.682589 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:14.683040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:14.683465 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:15.150348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:15.163495 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:15.165509 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:15.166704 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1ca3e337-71e3-412e-a970-f49ba554c381 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.496544 Oct 27 09:40:15.167276 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 297/587] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:14 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:40:15.182670 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-54275745-8ace-49d6-8754-d434f64748f9 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "POST /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/action" status: 202 len: 0 microversion: 2.1 time: 0.920350 Oct 27 09:40:15.183395 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 291/588] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:40:14 2022] POST /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/action => generated 0 bytes in 922 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:40:15.192368 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-82d490ea-ecf4-4157-a996-0f0a6a4bf11f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:15.193015 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-82d490ea-ecf4-4157-a996-0f0a6a4bf11f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:15.199261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82d490ea-ecf4-4157-a996-0f0a6a4bf11f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:15.199750 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82d490ea-ecf4-4157-a996-0f0a6a4bf11f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:15.199950 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-b3da5081-ead3-4aae-b652-c34006a970ae req-7f3d1287-b108-4595-849d-4adce2e631fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc27f94-5b44-482f-9d13-b102e27b7a10", "tag": "7969c643-a189-494b-ab3e-877a44420350"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:15.200180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82d490ea-ecf4-4157-a996-0f0a6a4bf11f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:15.200914 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82d490ea-ecf4-4157-a996-0f0a6a4bf11f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:15.201372 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82d490ea-ecf4-4157-a996-0f0a6a4bf11f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:15.201794 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82d490ea-ecf4-4157-a996-0f0a6a4bf11f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:15.210817 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b3da5081-ead3-4aae-b652-c34006a970ae req-7f3d1287-b108-4595-849d-4adce2e631fd service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:15.211500 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b3da5081-ead3-4aae-b652-c34006a970ae req-7f3d1287-b108-4595-849d-4adce2e631fd service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:15.212034 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b3da5081-ead3-4aae-b652-c34006a970ae req-7f3d1287-b108-4595-849d-4adce2e631fd service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:15.223912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-b3da5081-ead3-4aae-b652-c34006a970ae req-7f3d1287-b108-4595-849d-4adce2e631fd service nova] Creating event network-changed:7969c643-a189-494b-ab3e-877a44420350 for instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 on hv-cinder-79797 Oct 27 09:40:15.230328 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-b3da5081-ead3-4aae-b652-c34006a970ae req-7f3d1287-b108-4595-849d-4adce2e631fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034377 Oct 27 09:40:15.231065 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 292/589] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:15.288446 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2aeb3003-61ad-4613-9857-a76a373780d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:15.289235 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2aeb3003-61ad-4613-9857-a76a373780d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:15.296400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2aeb3003-61ad-4613-9857-a76a373780d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:15.296966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2aeb3003-61ad-4613-9857-a76a373780d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:15.297375 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2aeb3003-61ad-4613-9857-a76a373780d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:15.298080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2aeb3003-61ad-4613-9857-a76a373780d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:15.298535 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2aeb3003-61ad-4613-9857-a76a373780d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:15.298962 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2aeb3003-61ad-4613-9857-a76a373780d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:15.425437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-82d490ea-ecf4-4157-a996-0f0a6a4bf11f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:15.440723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-82d490ea-ecf4-4157-a996-0f0a6a4bf11f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1760 microversion: 2.1 time: 0.245437 Oct 27 09:40:15.440723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 298/590] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:15 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1760 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:15.461525 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2aeb3003-61ad-4613-9857-a76a373780d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:15.469862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2aeb3003-61ad-4613-9857-a76a373780d6 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.192724 Oct 27 09:40:15.470432 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 293/591] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:15 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:15.646908 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-61ceed68-a76d-449a-83ed-465aff7612cd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:15.647987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-61ceed68-a76d-449a-83ed-465aff7612cd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:15.654075 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61ceed68-a76d-449a-83ed-465aff7612cd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:15.655220 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61ceed68-a76d-449a-83ed-465aff7612cd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:15.655863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61ceed68-a76d-449a-83ed-465aff7612cd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:15.656588 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61ceed68-a76d-449a-83ed-465aff7612cd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:15.657212 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61ceed68-a76d-449a-83ed-465aff7612cd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:15.657892 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61ceed68-a76d-449a-83ed-465aff7612cd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:15.854390 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-61ceed68-a76d-449a-83ed-465aff7612cd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:15.861986 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-61ceed68-a76d-449a-83ed-465aff7612cd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.219283 Oct 27 09:40:15.862544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 299/592] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:15 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:16.193446 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:16.194049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:16.199778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:16.200257 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:16.200733 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:16.201416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:16.201863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:16.202547 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:16.235307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-6d235f96-00f0-4f92-9040-94637f3f305b req-d34ef306-1569-479b-b4df-705942a6e426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7372b52-0f50-4517-840c-c97081a05995", "name": "network-vif-plugged", "status": "completed", "tag": "d2dc3936-eb1d-4275-8a23-06d264b2ba89"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:16.246280 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-6d235f96-00f0-4f92-9040-94637f3f305b req-d34ef306-1569-479b-b4df-705942a6e426 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:16.247052 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-6d235f96-00f0-4f92-9040-94637f3f305b req-d34ef306-1569-479b-b4df-705942a6e426 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:16.247654 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-6d235f96-00f0-4f92-9040-94637f3f305b req-d34ef306-1569-479b-b4df-705942a6e426 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:16.273389 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-6d235f96-00f0-4f92-9040-94637f3f305b req-d34ef306-1569-479b-b4df-705942a6e426 service nova] Creating event network-vif-plugged:d2dc3936-eb1d-4275-8a23-06d264b2ba89 for instance f7372b52-0f50-4517-840c-c97081a05995 on hv-cinder-79797 Oct 27 09:40:16.280854 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-6d235f96-00f0-4f92-9040-94637f3f305b req-d34ef306-1569-479b-b4df-705942a6e426 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049274 Oct 27 09:40:16.282030 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 300/593] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:16.475636 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:16.494301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2bf34550-fb67-45a6-bf7d-55134bc750da tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:16.495568 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2bf34550-fb67-45a6-bf7d-55134bc750da tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:16.495731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:16.497340 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:16.499828 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e2b5d3c3-7138-49a3-814b-ac3f3b43dd9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.310276 Oct 27 09:40:16.501718 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 294/594] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:16 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:40:16.507104 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2bf34550-fb67-45a6-bf7d-55134bc750da tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:16.511255 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2bf34550-fb67-45a6-bf7d-55134bc750da tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:16.513460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2bf34550-fb67-45a6-bf7d-55134bc750da tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:16.514477 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2bf34550-fb67-45a6-bf7d-55134bc750da tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:16.515639 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2bf34550-fb67-45a6-bf7d-55134bc750da tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:16.516836 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2bf34550-fb67-45a6-bf7d-55134bc750da tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:16.537420 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-42661eb7-e6b8-47cb-a928-c791bbd4e849 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:16.544132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-42661eb7-e6b8-47cb-a928-c791bbd4e849 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:16.544846 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-42661eb7-e6b8-47cb-a928-c791bbd4e849 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:16.545975 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-42661eb7-e6b8-47cb-a928-c791bbd4e849 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:16.575780 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-42661eb7-e6b8-47cb-a928-c791bbd4e849 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Going to try to stop instance {{(pid=125362) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 09:40:16.620535 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-42661eb7-e6b8-47cb-a928-c791bbd4e849 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/action" status: 202 len: 0 microversion: 2.1 time: 0.086964 Oct 27 09:40:16.625820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 295/595] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:40:16 2022] POST /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:40:16.632856 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f2c23085-2643-4329-9daa-38b0bac7d7b7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:16.633881 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f2c23085-2643-4329-9daa-38b0bac7d7b7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:16.642190 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f2c23085-2643-4329-9daa-38b0bac7d7b7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:16.643042 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f2c23085-2643-4329-9daa-38b0bac7d7b7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:16.644092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f2c23085-2643-4329-9daa-38b0bac7d7b7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:16.645340 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f2c23085-2643-4329-9daa-38b0bac7d7b7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:16.645888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f2c23085-2643-4329-9daa-38b0bac7d7b7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:16.646715 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f2c23085-2643-4329-9daa-38b0bac7d7b7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:16.652399 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:16.795650 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2bf34550-fb67-45a6-bf7d-55134bc750da tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:16.804396 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2bf34550-fb67-45a6-bf7d-55134bc750da tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.315079 Oct 27 09:40:16.816655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 301/596] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:16 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:16.826145 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f2c23085-2643-4329-9daa-38b0bac7d7b7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:16.834666 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f2c23085-2643-4329-9daa-38b0bac7d7b7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.207443 Oct 27 09:40:16.835237 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 296/597] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:16 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:16.884842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c4a26817-013c-487d-853f-08fe9da22fe2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:16.885459 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c4a26817-013c-487d-853f-08fe9da22fe2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:16.891346 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4a26817-013c-487d-853f-08fe9da22fe2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:16.891830 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4a26817-013c-487d-853f-08fe9da22fe2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:16.892261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4a26817-013c-487d-853f-08fe9da22fe2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:16.892993 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4a26817-013c-487d-853f-08fe9da22fe2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:16.893450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4a26817-013c-487d-853f-08fe9da22fe2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:16.893877 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4a26817-013c-487d-853f-08fe9da22fe2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:17.025284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c4a26817-013c-487d-853f-08fe9da22fe2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:17.033420 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c4a26817-013c-487d-853f-08fe9da22fe2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.152478 Oct 27 09:40:17.034027 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 302/598] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:16 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:17.530784 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:17.531451 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:17.537982 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:17.538472 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:17.538909 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:17.539611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:17.540065 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:17.540538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:17.724866 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:17.734050 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:17.735500 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:17.736687 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3388352e-69a0-4c99-821b-d24929f03d71 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1808 microversion: 2.20 time: 0.210583 Oct 27 09:40:17.737249 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 297/599] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:17 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:40:17.828136 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f20cf754-0796-46e8-ab16-b261df1ff7ec tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:17.828811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f20cf754-0796-46e8-ab16-b261df1ff7ec tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:17.836139 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f20cf754-0796-46e8-ab16-b261df1ff7ec tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:17.836660 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f20cf754-0796-46e8-ab16-b261df1ff7ec tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:17.837122 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f20cf754-0796-46e8-ab16-b261df1ff7ec tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:17.837812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f20cf754-0796-46e8-ab16-b261df1ff7ec tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:17.838265 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f20cf754-0796-46e8-ab16-b261df1ff7ec tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:17.838694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f20cf754-0796-46e8-ab16-b261df1ff7ec tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:17.857498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-26d2f5fa-e164-49a5-8998-d7cec737460f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:17.858231 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-26d2f5fa-e164-49a5-8998-d7cec737460f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:17.864172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26d2f5fa-e164-49a5-8998-d7cec737460f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:17.864765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26d2f5fa-e164-49a5-8998-d7cec737460f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:17.865284 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26d2f5fa-e164-49a5-8998-d7cec737460f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:17.866047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26d2f5fa-e164-49a5-8998-d7cec737460f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:17.866570 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26d2f5fa-e164-49a5-8998-d7cec737460f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:17.867064 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-26d2f5fa-e164-49a5-8998-d7cec737460f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:18.038180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f20cf754-0796-46e8-ab16-b261df1ff7ec tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:18.044902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-26d2f5fa-e164-49a5-8998-d7cec737460f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:18.047273 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f20cf754-0796-46e8-ab16-b261df1ff7ec tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.223836 Oct 27 09:40:18.047855 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 303/600] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:17 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:18.055173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-26d2f5fa-e164-49a5-8998-d7cec737460f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.201471 Oct 27 09:40:18.055887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 298/601] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:17 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:18.057887 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-645acd40-451d-4545-8c29-2e7e4312ec57 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:18.058594 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-645acd40-451d-4545-8c29-2e7e4312ec57 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:18.065783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-645acd40-451d-4545-8c29-2e7e4312ec57 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:18.066412 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-645acd40-451d-4545-8c29-2e7e4312ec57 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:18.066912 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-645acd40-451d-4545-8c29-2e7e4312ec57 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:18.067655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-645acd40-451d-4545-8c29-2e7e4312ec57 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:18.068187 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-645acd40-451d-4545-8c29-2e7e4312ec57 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:18.068712 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-645acd40-451d-4545-8c29-2e7e4312ec57 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:18.195141 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-645acd40-451d-4545-8c29-2e7e4312ec57 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:18.202974 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-645acd40-451d-4545-8c29-2e7e4312ec57 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.149191 Oct 27 09:40:18.203597 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 304/602] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:18 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:18.415169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-9eff5130-05fd-4403-a834-3652aadebfd2 req-02b2ccd6-35ac-4f6d-ac2a-ab1a1144db61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0757d24a-7369-4583-8b26-85d48e0ba6cf", "name": "network-vif-plugged", "status": "completed", "tag": "679f3124-ba7d-4f06-8f2b-63d51480c3ff"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:18.425322 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9eff5130-05fd-4403-a834-3652aadebfd2 req-02b2ccd6-35ac-4f6d-ac2a-ab1a1144db61 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:18.425799 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9eff5130-05fd-4403-a834-3652aadebfd2 req-02b2ccd6-35ac-4f6d-ac2a-ab1a1144db61 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:18.426225 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9eff5130-05fd-4403-a834-3652aadebfd2 req-02b2ccd6-35ac-4f6d-ac2a-ab1a1144db61 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:18.436831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-9eff5130-05fd-4403-a834-3652aadebfd2 req-02b2ccd6-35ac-4f6d-ac2a-ab1a1144db61 service nova] Creating event network-vif-plugged:679f3124-ba7d-4f06-8f2b-63d51480c3ff for instance 0757d24a-7369-4583-8b26-85d48e0ba6cf on hv-cinder-79797 Oct 27 09:40:18.441550 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-9eff5130-05fd-4403-a834-3652aadebfd2 req-02b2ccd6-35ac-4f6d-ac2a-ab1a1144db61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030038 Oct 27 09:40:18.442505 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 299/603] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:18.762624 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:18.763242 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:18.769177 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:18.769661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:18.770096 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:18.770783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:18.771240 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:18.771667 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:18.898956 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:18.907497 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:18.909083 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:18.910234 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cfba7f37-f75a-4b87-b4ce-c86236bb3923 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1795 microversion: 2.20 time: 0.151584 Oct 27 09:40:18.910993 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 305/604] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:40:18 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1795 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:40:19.071356 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-849de5b1-44ad-4437-bb87-4bfab8d5f5ae tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:19.072065 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-849de5b1-44ad-4437-bb87-4bfab8d5f5ae tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:19.078607 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a93c88e3-61ed-4f7c-88e4-4e39ee2555d9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:19.078810 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849de5b1-44ad-4437-bb87-4bfab8d5f5ae tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:19.079221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849de5b1-44ad-4437-bb87-4bfab8d5f5ae tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:19.079339 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a93c88e3-61ed-4f7c-88e4-4e39ee2555d9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:19.079654 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849de5b1-44ad-4437-bb87-4bfab8d5f5ae tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:19.080352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849de5b1-44ad-4437-bb87-4bfab8d5f5ae tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:19.080833 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849de5b1-44ad-4437-bb87-4bfab8d5f5ae tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:19.081254 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-849de5b1-44ad-4437-bb87-4bfab8d5f5ae tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:19.086436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a93c88e3-61ed-4f7c-88e4-4e39ee2555d9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:19.086436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a93c88e3-61ed-4f7c-88e4-4e39ee2555d9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:19.086436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a93c88e3-61ed-4f7c-88e4-4e39ee2555d9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:19.086842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a93c88e3-61ed-4f7c-88e4-4e39ee2555d9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:19.087297 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a93c88e3-61ed-4f7c-88e4-4e39ee2555d9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:19.087722 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a93c88e3-61ed-4f7c-88e4-4e39ee2555d9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:19.285559 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a93c88e3-61ed-4f7c-88e4-4e39ee2555d9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:19.289644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-849de5b1-44ad-4437-bb87-4bfab8d5f5ae tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:19.293376 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a93c88e3-61ed-4f7c-88e4-4e39ee2555d9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.218844 Oct 27 09:40:19.293943 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 306/605] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:19 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:19.298211 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-849de5b1-44ad-4437-bb87-4bfab8d5f5ae tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1318 microversion: 2.1 time: 0.231568 Oct 27 09:40:19.298988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 300/606] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:19 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:19.299114 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f3e6790a-3adb-429f-8468-919ae8a0b291 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:19.299589 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f3e6790a-3adb-429f-8468-919ae8a0b291 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:19.305246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e6790a-3adb-429f-8468-919ae8a0b291 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:19.305721 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e6790a-3adb-429f-8468-919ae8a0b291 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:19.306149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e6790a-3adb-429f-8468-919ae8a0b291 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:19.306824 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e6790a-3adb-429f-8468-919ae8a0b291 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:19.307269 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e6790a-3adb-429f-8468-919ae8a0b291 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:19.307680 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3e6790a-3adb-429f-8468-919ae8a0b291 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:19.436850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f3e6790a-3adb-429f-8468-919ae8a0b291 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:19.444362 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f3e6790a-3adb-429f-8468-919ae8a0b291 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.149483 Oct 27 09:40:19.444956 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 307/607] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:19 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:20.318476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-328efe59-042c-4a77-ab67-33483753ba29 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:20.319094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-328efe59-042c-4a77-ab67-33483753ba29 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:20.320937 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e63b9ffc-496c-42f7-8d31-05b96609061f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:20.321542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e63b9ffc-496c-42f7-8d31-05b96609061f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:20.325690 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-328efe59-042c-4a77-ab67-33483753ba29 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:20.326119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-328efe59-042c-4a77-ab67-33483753ba29 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:20.326558 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-328efe59-042c-4a77-ab67-33483753ba29 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:20.327549 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-328efe59-042c-4a77-ab67-33483753ba29 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:20.328095 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e63b9ffc-496c-42f7-8d31-05b96609061f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:20.328203 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-328efe59-042c-4a77-ab67-33483753ba29 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:20.328564 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-328efe59-042c-4a77-ab67-33483753ba29 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:20.328665 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e63b9ffc-496c-42f7-8d31-05b96609061f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:20.329022 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e63b9ffc-496c-42f7-8d31-05b96609061f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:20.329696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e63b9ffc-496c-42f7-8d31-05b96609061f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:20.330148 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e63b9ffc-496c-42f7-8d31-05b96609061f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:20.330559 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e63b9ffc-496c-42f7-8d31-05b96609061f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:20.522299 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-328efe59-042c-4a77-ab67-33483753ba29 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:20.525436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e63b9ffc-496c-42f7-8d31-05b96609061f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:20.530472 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-328efe59-042c-4a77-ab67-33483753ba29 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.216428 Oct 27 09:40:20.531122 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 301/608] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:20 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:20.534142 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e63b9ffc-496c-42f7-8d31-05b96609061f tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1506 microversion: 2.1 time: 0.216897 Oct 27 09:40:20.535764 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f8c505dc-9fb1-463b-b2c2-0116c4d268c2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:20.536431 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f8c505dc-9fb1-463b-b2c2-0116c4d268c2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:20.539287 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 308/609] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:20 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:20.542626 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8c505dc-9fb1-463b-b2c2-0116c4d268c2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:20.543141 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8c505dc-9fb1-463b-b2c2-0116c4d268c2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:20.543579 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8c505dc-9fb1-463b-b2c2-0116c4d268c2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:20.544398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8c505dc-9fb1-463b-b2c2-0116c4d268c2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:20.544888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8c505dc-9fb1-463b-b2c2-0116c4d268c2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:20.546117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8c505dc-9fb1-463b-b2c2-0116c4d268c2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:20.556618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-62bb008b-366f-4a61-8de6-275db2870d02 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46488bd2-f88a-40fb-9b98-a7afc2eda4a3", "device": "/dev/sdb"}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:20.559680 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-62bb008b-366f-4a61-8de6-275db2870d02 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:20.565617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-62bb008b-366f-4a61-8de6-275db2870d02 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:20.566104 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-62bb008b-366f-4a61-8de6-275db2870d02 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:20.566535 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-62bb008b-366f-4a61-8de6-275db2870d02 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:20.567268 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-62bb008b-366f-4a61-8de6-275db2870d02 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:20.567723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-62bb008b-366f-4a61-8de6-275db2870d02 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:20.568147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-62bb008b-366f-4a61-8de6-275db2870d02 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:20.678024 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f8c505dc-9fb1-463b-b2c2-0116c4d268c2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:20.695000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f8c505dc-9fb1-463b-b2c2-0116c4d268c2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.162747 Oct 27 09:40:20.695622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 302/610] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:20 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:20.837878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-62bb008b-366f-4a61-8de6-275db2870d02 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "POST /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284994 Oct 27 09:40:20.838521 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 309/611] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:40:20 2022] POST /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:40:21.554201 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1a6f8048-15cf-4232-aebc-b945200028da tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:21.554896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1a6f8048-15cf-4232-aebc-b945200028da tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:21.562121 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a6f8048-15cf-4232-aebc-b945200028da tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:21.562748 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a6f8048-15cf-4232-aebc-b945200028da tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:21.563214 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a6f8048-15cf-4232-aebc-b945200028da tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:21.564043 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a6f8048-15cf-4232-aebc-b945200028da tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:21.564560 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a6f8048-15cf-4232-aebc-b945200028da tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:21.564986 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a6f8048-15cf-4232-aebc-b945200028da tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:21.694499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1a6f8048-15cf-4232-aebc-b945200028da tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:21.702391 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1a6f8048-15cf-4232-aebc-b945200028da tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.151950 Oct 27 09:40:21.702963 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 303/612] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:21 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:21.719414 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-61d0078d-ea43-4c31-bdc9-5ed1ada94e61 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:21.720193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-61d0078d-ea43-4c31-bdc9-5ed1ada94e61 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:21.726235 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61d0078d-ea43-4c31-bdc9-5ed1ada94e61 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:21.726716 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61d0078d-ea43-4c31-bdc9-5ed1ada94e61 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:21.727150 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61d0078d-ea43-4c31-bdc9-5ed1ada94e61 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:21.727831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61d0078d-ea43-4c31-bdc9-5ed1ada94e61 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:21.728285 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61d0078d-ea43-4c31-bdc9-5ed1ada94e61 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:21.728744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-61d0078d-ea43-4c31-bdc9-5ed1ada94e61 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:21.855036 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-61d0078d-ea43-4c31-bdc9-5ed1ada94e61 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:21.863325 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-61d0078d-ea43-4c31-bdc9-5ed1ada94e61 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.148545 Oct 27 09:40:21.863885 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 310/613] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:21 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:22.725531 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4395a692-dbac-42e8-949b-db5cd270494a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:22.726141 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4395a692-dbac-42e8-949b-db5cd270494a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:22.733101 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4395a692-dbac-42e8-949b-db5cd270494a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:22.733581 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4395a692-dbac-42e8-949b-db5cd270494a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:22.734016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4395a692-dbac-42e8-949b-db5cd270494a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:22.734705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4395a692-dbac-42e8-949b-db5cd270494a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:22.735161 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4395a692-dbac-42e8-949b-db5cd270494a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:22.735582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4395a692-dbac-42e8-949b-db5cd270494a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:22.859908 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4395a692-dbac-42e8-949b-db5cd270494a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:22.868248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4395a692-dbac-42e8-949b-db5cd270494a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.146528 Oct 27 09:40:22.868847 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 304/614] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:22 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:22.886643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6c5fee37-5936-4d0d-8d40-34ca889f7216 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:22.887259 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6c5fee37-5936-4d0d-8d40-34ca889f7216 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:22.893730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c5fee37-5936-4d0d-8d40-34ca889f7216 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:22.894213 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c5fee37-5936-4d0d-8d40-34ca889f7216 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:22.894676 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c5fee37-5936-4d0d-8d40-34ca889f7216 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:22.895361 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c5fee37-5936-4d0d-8d40-34ca889f7216 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:22.895814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c5fee37-5936-4d0d-8d40-34ca889f7216 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:22.896237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c5fee37-5936-4d0d-8d40-34ca889f7216 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:22.900342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:23.030068 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6c5fee37-5936-4d0d-8d40-34ca889f7216 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:23.037773 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6c5fee37-5936-4d0d-8d40-34ca889f7216 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1368 microversion: 2.1 time: 0.154940 Oct 27 09:40:23.038345 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 311/615] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:22 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:23.891625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3161afb6-636a-464c-bfaa-cc26c433e98b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:23.892172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-3161afb6-636a-464c-bfaa-cc26c433e98b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:23.898520 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3161afb6-636a-464c-bfaa-cc26c433e98b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:23.898992 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3161afb6-636a-464c-bfaa-cc26c433e98b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:23.899441 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3161afb6-636a-464c-bfaa-cc26c433e98b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:23.900101 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3161afb6-636a-464c-bfaa-cc26c433e98b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:23.900573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3161afb6-636a-464c-bfaa-cc26c433e98b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:23.900989 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3161afb6-636a-464c-bfaa-cc26c433e98b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:24.027103 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-3161afb6-636a-464c-bfaa-cc26c433e98b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:24.034815 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3161afb6-636a-464c-bfaa-cc26c433e98b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.147612 Oct 27 09:40:24.035885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 305/616] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:23 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:24.061469 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-05c26277-8266-4fd5-9819-8063128c6462 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:24.062087 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-05c26277-8266-4fd5-9819-8063128c6462 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:24.068786 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-05c26277-8266-4fd5-9819-8063128c6462 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:24.069274 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-05c26277-8266-4fd5-9819-8063128c6462 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:24.069712 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-05c26277-8266-4fd5-9819-8063128c6462 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:24.070401 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-05c26277-8266-4fd5-9819-8063128c6462 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:24.070856 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-05c26277-8266-4fd5-9819-8063128c6462 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:24.071280 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-05c26277-8266-4fd5-9819-8063128c6462 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:24.202690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-05c26277-8266-4fd5-9819-8063128c6462 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:24.210270 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-05c26277-8266-4fd5-9819-8063128c6462 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1559 microversion: 2.1 time: 0.153140 Oct 27 09:40:24.210843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 312/617] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:24 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:24.233119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4061e874-590a-4431-a83a-b371795d168c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:24.233621 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4061e874-590a-4431-a83a-b371795d168c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:24.239587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4061e874-590a-4431-a83a-b371795d168c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:24.240069 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4061e874-590a-4431-a83a-b371795d168c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:24.240505 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4061e874-590a-4431-a83a-b371795d168c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:24.241217 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4061e874-590a-4431-a83a-b371795d168c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:24.241669 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4061e874-590a-4431-a83a-b371795d168c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:24.242089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4061e874-590a-4431-a83a-b371795d168c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:24.319483 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4061e874-590a-4431-a83a-b371795d168c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090730 Oct 27 09:40:24.320076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 306/618] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Oct 27 09:40:24 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:25.059396 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4f7d6d46-d7af-4d9a-b34a-90038e748ec4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:25.060150 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4f7d6d46-d7af-4d9a-b34a-90038e748ec4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:25.067293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f7d6d46-d7af-4d9a-b34a-90038e748ec4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:25.067877 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f7d6d46-d7af-4d9a-b34a-90038e748ec4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:25.068334 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f7d6d46-d7af-4d9a-b34a-90038e748ec4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:25.069068 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f7d6d46-d7af-4d9a-b34a-90038e748ec4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:25.069523 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f7d6d46-d7af-4d9a-b34a-90038e748ec4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:25.069949 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f7d6d46-d7af-4d9a-b34a-90038e748ec4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:25.499783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4f7d6d46-d7af-4d9a-b34a-90038e748ec4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:25.508739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4f7d6d46-d7af-4d9a-b34a-90038e748ec4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.453170 Oct 27 09:40:25.509315 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 313/619] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:25 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:25.511446 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-5173f3a4-5a64-4837-994a-3c56e7235d1c req-7736f396-827d-4d9b-99b8-0a369acfcf40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0757d24a-7369-4583-8b26-85d48e0ba6cf", "tag": "679f3124-ba7d-4f06-8f2b-63d51480c3ff"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:25.521259 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5173f3a4-5a64-4837-994a-3c56e7235d1c req-7736f396-827d-4d9b-99b8-0a369acfcf40 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:25.521860 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5173f3a4-5a64-4837-994a-3c56e7235d1c req-7736f396-827d-4d9b-99b8-0a369acfcf40 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:25.522394 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5173f3a4-5a64-4837-994a-3c56e7235d1c req-7736f396-827d-4d9b-99b8-0a369acfcf40 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:25.533763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-5173f3a4-5a64-4837-994a-3c56e7235d1c req-7736f396-827d-4d9b-99b8-0a369acfcf40 service nova] Creating event network-changed:679f3124-ba7d-4f06-8f2b-63d51480c3ff for instance 0757d24a-7369-4583-8b26-85d48e0ba6cf on hv-cinder-79797 Oct 27 09:40:25.539013 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-5173f3a4-5a64-4837-994a-3c56e7235d1c req-7736f396-827d-4d9b-99b8-0a369acfcf40 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032269 Oct 27 09:40:25.539761 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 307/620] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:26.532752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b05a8faa-b727-4894-88e1-c015f3198d90 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:26.533445 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b05a8faa-b727-4894-88e1-c015f3198d90 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:26.539821 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b05a8faa-b727-4894-88e1-c015f3198d90 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:26.540307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b05a8faa-b727-4894-88e1-c015f3198d90 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:26.540769 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b05a8faa-b727-4894-88e1-c015f3198d90 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:26.541460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b05a8faa-b727-4894-88e1-c015f3198d90 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:26.541926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b05a8faa-b727-4894-88e1-c015f3198d90 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:26.542369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b05a8faa-b727-4894-88e1-c015f3198d90 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:26.669201 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b05a8faa-b727-4894-88e1-c015f3198d90 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:26.677359 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b05a8faa-b727-4894-88e1-c015f3198d90 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.149212 Oct 27 09:40:26.677921 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 314/621] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:26 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:27.702221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5614d87e-d9ae-481f-8e4a-0ca2c8ae3c93 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:27.702849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5614d87e-d9ae-481f-8e4a-0ca2c8ae3c93 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:27.704828 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=82 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:27.710275 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5614d87e-d9ae-481f-8e4a-0ca2c8ae3c93 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:27.710759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5614d87e-d9ae-481f-8e4a-0ca2c8ae3c93 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:27.711197 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5614d87e-d9ae-481f-8e4a-0ca2c8ae3c93 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:27.711887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5614d87e-d9ae-481f-8e4a-0ca2c8ae3c93 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:27.712341 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5614d87e-d9ae-481f-8e4a-0ca2c8ae3c93 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:27.712793 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5614d87e-d9ae-481f-8e4a-0ca2c8ae3c93 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:27.845948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5614d87e-d9ae-481f-8e4a-0ca2c8ae3c93 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:27.853564 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5614d87e-d9ae-481f-8e4a-0ca2c8ae3c93 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.156949 Oct 27 09:40:27.854128 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 308/622] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:27 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:28.876604 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-30c39ec0-5dd9-4a79-8a91-98891f73b689 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:28.877210 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-30c39ec0-5dd9-4a79-8a91-98891f73b689 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:28.883587 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-30c39ec0-5dd9-4a79-8a91-98891f73b689 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:28.884063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-30c39ec0-5dd9-4a79-8a91-98891f73b689 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:28.884495 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-30c39ec0-5dd9-4a79-8a91-98891f73b689 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:28.885197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-30c39ec0-5dd9-4a79-8a91-98891f73b689 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:28.885674 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-30c39ec0-5dd9-4a79-8a91-98891f73b689 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:28.886094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-30c39ec0-5dd9-4a79-8a91-98891f73b689 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:29.010954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-30c39ec0-5dd9-4a79-8a91-98891f73b689 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:29.018597 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-30c39ec0-5dd9-4a79-8a91-98891f73b689 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.146429 Oct 27 09:40:29.019161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 315/623] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:28 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:30.041215 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8535e61b-4c71-40b3-8f69-14f901e49466 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:30.041758 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8535e61b-4c71-40b3-8f69-14f901e49466 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:30.048902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8535e61b-4c71-40b3-8f69-14f901e49466 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:30.049393 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8535e61b-4c71-40b3-8f69-14f901e49466 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:30.049833 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8535e61b-4c71-40b3-8f69-14f901e49466 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:30.050530 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8535e61b-4c71-40b3-8f69-14f901e49466 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:30.050988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8535e61b-4c71-40b3-8f69-14f901e49466 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:30.051425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8535e61b-4c71-40b3-8f69-14f901e49466 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:30.179965 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8535e61b-4c71-40b3-8f69-14f901e49466 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:30.187634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8535e61b-4c71-40b3-8f69-14f901e49466 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.150434 Oct 27 09:40:30.188427 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 309/624] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:30 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:31.210694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1ab8be74-b058-4938-9dee-cc76ac5c3ca4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:31.211295 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1ab8be74-b058-4938-9dee-cc76ac5c3ca4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:31.217772 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ab8be74-b058-4938-9dee-cc76ac5c3ca4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:31.218250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ab8be74-b058-4938-9dee-cc76ac5c3ca4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:31.218678 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ab8be74-b058-4938-9dee-cc76ac5c3ca4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:31.219374 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ab8be74-b058-4938-9dee-cc76ac5c3ca4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:31.219822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ab8be74-b058-4938-9dee-cc76ac5c3ca4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:31.220239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ab8be74-b058-4938-9dee-cc76ac5c3ca4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:31.350209 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1ab8be74-b058-4938-9dee-cc76ac5c3ca4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:31.357858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1ab8be74-b058-4938-9dee-cc76ac5c3ca4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.150948 Oct 27 09:40:31.359048 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 316/625] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:31 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:32.381709 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-779ac225-41f5-42b6-a806-3444820f8f6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:32.382316 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-779ac225-41f5-42b6-a806-3444820f8f6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:32.388852 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-779ac225-41f5-42b6-a806-3444820f8f6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:32.389335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-779ac225-41f5-42b6-a806-3444820f8f6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:32.389770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-779ac225-41f5-42b6-a806-3444820f8f6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:32.390454 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-779ac225-41f5-42b6-a806-3444820f8f6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:32.390906 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-779ac225-41f5-42b6-a806-3444820f8f6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:32.391330 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-779ac225-41f5-42b6-a806-3444820f8f6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:32.517865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-779ac225-41f5-42b6-a806-3444820f8f6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:32.525584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-779ac225-41f5-42b6-a806-3444820f8f6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.147738 Oct 27 09:40:32.526151 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 310/626] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:32 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:33.549665 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0b781f94-bbee-4fac-8e11-66ebab52e230 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:33.550166 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0b781f94-bbee-4fac-8e11-66ebab52e230 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:33.556853 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b781f94-bbee-4fac-8e11-66ebab52e230 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:33.557331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b781f94-bbee-4fac-8e11-66ebab52e230 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:33.557763 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b781f94-bbee-4fac-8e11-66ebab52e230 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:33.558447 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b781f94-bbee-4fac-8e11-66ebab52e230 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:33.558900 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b781f94-bbee-4fac-8e11-66ebab52e230 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:33.559356 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b781f94-bbee-4fac-8e11-66ebab52e230 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:33.690856 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0b781f94-bbee-4fac-8e11-66ebab52e230 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:33.698426 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0b781f94-bbee-4fac-8e11-66ebab52e230 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.152823 Oct 27 09:40:33.698990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 317/627] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:33 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:34.722894 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4a2daf50-5982-4fe3-9511-e75b8d83430e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:34.723507 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4a2daf50-5982-4fe3-9511-e75b8d83430e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:34.729879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4a2daf50-5982-4fe3-9511-e75b8d83430e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:34.730354 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4a2daf50-5982-4fe3-9511-e75b8d83430e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:34.730776 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4a2daf50-5982-4fe3-9511-e75b8d83430e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:34.731465 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4a2daf50-5982-4fe3-9511-e75b8d83430e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:34.731920 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4a2daf50-5982-4fe3-9511-e75b8d83430e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:34.732342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4a2daf50-5982-4fe3-9511-e75b8d83430e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:34.859973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4a2daf50-5982-4fe3-9511-e75b8d83430e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:34.867745 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4a2daf50-5982-4fe3-9511-e75b8d83430e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.148731 Oct 27 09:40:34.868357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 311/628] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:34 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:35.891062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-467ba18a-293e-445f-ac27-a12f485641df tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:35.891705 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-467ba18a-293e-445f-ac27-a12f485641df tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:35.898202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-467ba18a-293e-445f-ac27-a12f485641df tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:35.898687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-467ba18a-293e-445f-ac27-a12f485641df tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:35.899122 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-467ba18a-293e-445f-ac27-a12f485641df tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:35.899839 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-467ba18a-293e-445f-ac27-a12f485641df tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:35.900298 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-467ba18a-293e-445f-ac27-a12f485641df tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:35.900746 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-467ba18a-293e-445f-ac27-a12f485641df tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:36.036505 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-467ba18a-293e-445f-ac27-a12f485641df tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:36.046921 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-467ba18a-293e-445f-ac27-a12f485641df tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1676 microversion: 2.1 time: 0.159589 Oct 27 09:40:36.047500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 318/629] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:35 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:37.070316 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5dc219f3-6d36-4484-8aed-dc9a2d9d81d7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:37.070928 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5dc219f3-6d36-4484-8aed-dc9a2d9d81d7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:37.078200 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5dc219f3-6d36-4484-8aed-dc9a2d9d81d7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:37.078680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5dc219f3-6d36-4484-8aed-dc9a2d9d81d7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:37.079137 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5dc219f3-6d36-4484-8aed-dc9a2d9d81d7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:37.080126 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5dc219f3-6d36-4484-8aed-dc9a2d9d81d7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:37.080915 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5dc219f3-6d36-4484-8aed-dc9a2d9d81d7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:37.081606 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5dc219f3-6d36-4484-8aed-dc9a2d9d81d7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:37.211221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5dc219f3-6d36-4484-8aed-dc9a2d9d81d7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:37.219443 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5dc219f3-6d36-4484-8aed-dc9a2d9d81d7 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1653 microversion: 2.1 time: 0.153088 Oct 27 09:40:37.220006 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 312/630] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:37 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1653 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:37.241573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-024c08de-47b5-45c5-a5e2-9bbfc6def23b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:37.248132 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-024c08de-47b5-45c5-a5e2-9bbfc6def23b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:37.248652 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-024c08de-47b5-45c5-a5e2-9bbfc6def23b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:37.249090 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-024c08de-47b5-45c5-a5e2-9bbfc6def23b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:37.271347 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-024c08de-47b5-45c5-a5e2-9bbfc6def23b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Going to try to start instance {{(pid=125361) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 09:40:37.313251 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-024c08de-47b5-45c5-a5e2-9bbfc6def23b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/action" status: 202 len: 0 microversion: 2.1 time: 0.075356 Oct 27 09:40:37.313849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 319/631] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:40:37 2022] POST /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:40:37.322014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5154fda5-77ad-4178-9e75-84cb550c18ab tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:37.322656 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5154fda5-77ad-4178-9e75-84cb550c18ab tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:37.329414 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5154fda5-77ad-4178-9e75-84cb550c18ab tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:37.329898 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5154fda5-77ad-4178-9e75-84cb550c18ab tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:37.330336 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5154fda5-77ad-4178-9e75-84cb550c18ab tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:37.331028 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5154fda5-77ad-4178-9e75-84cb550c18ab tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:37.331486 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5154fda5-77ad-4178-9e75-84cb550c18ab tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:37.331932 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5154fda5-77ad-4178-9e75-84cb550c18ab tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:37.461694 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5154fda5-77ad-4178-9e75-84cb550c18ab tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:37.469416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5154fda5-77ad-4178-9e75-84cb550c18ab tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1662 microversion: 2.1 time: 0.151203 Oct 27 09:40:37.469980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 313/632] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:37 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1662 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:38.493202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2733d0d6-3da4-49f6-a5e8-e8000facca05 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:38.493898 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2733d0d6-3da4-49f6-a5e8-e8000facca05 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:38.500402 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2733d0d6-3da4-49f6-a5e8-e8000facca05 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:38.500909 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2733d0d6-3da4-49f6-a5e8-e8000facca05 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:38.501337 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2733d0d6-3da4-49f6-a5e8-e8000facca05 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:38.502012 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2733d0d6-3da4-49f6-a5e8-e8000facca05 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:38.502456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2733d0d6-3da4-49f6-a5e8-e8000facca05 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:38.502870 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2733d0d6-3da4-49f6-a5e8-e8000facca05 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:38.642726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2733d0d6-3da4-49f6-a5e8-e8000facca05 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:38.650606 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2733d0d6-3da4-49f6-a5e8-e8000facca05 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1662 microversion: 2.1 time: 0.162069 Oct 27 09:40:38.651341 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 320/633] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:38 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:39.674353 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-50ca92c3-1f60-4ebb-bad0-132fc8648970 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:39.674967 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-50ca92c3-1f60-4ebb-bad0-132fc8648970 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:39.681404 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50ca92c3-1f60-4ebb-bad0-132fc8648970 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:39.681894 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50ca92c3-1f60-4ebb-bad0-132fc8648970 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:39.682331 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50ca92c3-1f60-4ebb-bad0-132fc8648970 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:39.683021 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50ca92c3-1f60-4ebb-bad0-132fc8648970 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:39.683476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50ca92c3-1f60-4ebb-bad0-132fc8648970 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:39.683905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-50ca92c3-1f60-4ebb-bad0-132fc8648970 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:39.701570 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:39.811024 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-50ca92c3-1f60-4ebb-bad0-132fc8648970 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:39.818726 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-50ca92c3-1f60-4ebb-bad0-132fc8648970 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1666 microversion: 2.1 time: 0.148821 Oct 27 09:40:39.819294 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 314/634] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:39 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1666 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:40.209653 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6ea743b8-59fa-4dcc-9f49-eb919ee5c9c1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:40.210138 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6ea743b8-59fa-4dcc-9f49-eb919ee5c9c1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:40.216507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ea743b8-59fa-4dcc-9f49-eb919ee5c9c1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:40.217020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ea743b8-59fa-4dcc-9f49-eb919ee5c9c1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:40.217454 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ea743b8-59fa-4dcc-9f49-eb919ee5c9c1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:40.218167 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ea743b8-59fa-4dcc-9f49-eb919ee5c9c1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:40.219210 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ea743b8-59fa-4dcc-9f49-eb919ee5c9c1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:40.219635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ea743b8-59fa-4dcc-9f49-eb919ee5c9c1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:40.301820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-6ea743b8-59fa-4dcc-9f49-eb919ee5c9c1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lazy-loading 'services' on Instance uuid f7372b52-0f50-4517-840c-c97081a05995 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:40:40.373798 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6ea743b8-59fa-4dcc-9f49-eb919ee5c9c1 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995/os-volume_attachments/46488bd2-f88a-40fb-9b98-a7afc2eda4a3" status: 202 len: 0 microversion: 2.1 time: 0.167917 Oct 27 09:40:40.374414 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 321/635] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:40:40 2022] DELETE /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995/os-volume_attachments/46488bd2-f88a-40fb-9b98-a7afc2eda4a3 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:40:42.552313 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-603c23c3-b940-491c-9c9a-0cf86c5216ab tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:42.552798 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-603c23c3-b940-491c-9c9a-0cf86c5216ab tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:42.559358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-603c23c3-b940-491c-9c9a-0cf86c5216ab tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:42.559843 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-603c23c3-b940-491c-9c9a-0cf86c5216ab tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:42.560278 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-603c23c3-b940-491c-9c9a-0cf86c5216ab tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:42.561003 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-603c23c3-b940-491c-9c9a-0cf86c5216ab tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:42.561463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-603c23c3-b940-491c-9c9a-0cf86c5216ab tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:42.561891 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-603c23c3-b940-491c-9c9a-0cf86c5216ab tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:42.587082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-603c23c3-b940-491c-9c9a-0cf86c5216ab tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:40:42.660373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-603c23c3-b940-491c-9c9a-0cf86c5216ab tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 204 len: 0 microversion: 2.1 time: 0.111626 Oct 27 09:40:42.661183 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 315/636] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:40:42 2022] DELETE /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:40:42.670239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7343fa58-bf6d-45ce-9668-a4385a0b08f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:42.671024 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7343fa58-bf6d-45ce-9668-a4385a0b08f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:42.673656 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=63 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:42.679026 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7343fa58-bf6d-45ce-9668-a4385a0b08f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:42.679519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7343fa58-bf6d-45ce-9668-a4385a0b08f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:42.679959 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7343fa58-bf6d-45ce-9668-a4385a0b08f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:42.680696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7343fa58-bf6d-45ce-9668-a4385a0b08f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:42.681149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7343fa58-bf6d-45ce-9668-a4385a0b08f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:42.681574 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7343fa58-bf6d-45ce-9668-a4385a0b08f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:42.812799 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7343fa58-bf6d-45ce-9668-a4385a0b08f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:42.820501 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7343fa58-bf6d-45ce-9668-a4385a0b08f8 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1512 microversion: 2.1 time: 0.154975 Oct 27 09:40:42.821092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 322/637] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:42 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:43.843652 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ee04e24e-60ee-4310-9b3e-7976b7ed68cc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:43.844417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ee04e24e-60ee-4310-9b3e-7976b7ed68cc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:43.850816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee04e24e-60ee-4310-9b3e-7976b7ed68cc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:43.851299 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee04e24e-60ee-4310-9b3e-7976b7ed68cc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:43.851740 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee04e24e-60ee-4310-9b3e-7976b7ed68cc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:43.852431 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee04e24e-60ee-4310-9b3e-7976b7ed68cc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:43.852912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee04e24e-60ee-4310-9b3e-7976b7ed68cc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:43.853334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ee04e24e-60ee-4310-9b3e-7976b7ed68cc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:43.982506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ee04e24e-60ee-4310-9b3e-7976b7ed68cc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:43.990679 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ee04e24e-60ee-4310-9b3e-7976b7ed68cc tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1512 microversion: 2.1 time: 0.151285 Oct 27 09:40:43.991249 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 316/638] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:43 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:45.013734 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-76469b4d-33ad-4763-a98a-26f8225930e2 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:45.014360 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-76469b4d-33ad-4763-a98a-26f8225930e2 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:45.022446 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-76469b4d-33ad-4763-a98a-26f8225930e2 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:45.022944 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-76469b4d-33ad-4763-a98a-26f8225930e2 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:45.023381 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-76469b4d-33ad-4763-a98a-26f8225930e2 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:45.024078 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-76469b4d-33ad-4763-a98a-26f8225930e2 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:45.024555 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-76469b4d-33ad-4763-a98a-26f8225930e2 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:45.025016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-76469b4d-33ad-4763-a98a-26f8225930e2 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:45.151929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-76469b4d-33ad-4763-a98a-26f8225930e2 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:45.159591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-76469b4d-33ad-4763-a98a-26f8225930e2 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1512 microversion: 2.1 time: 0.149754 Oct 27 09:40:45.160161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 323/639] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:45 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:40:45.818540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-aa7d25d1-7be1-4b05-bbf5-8480a5b30ba9 req-4f3ad62b-2c3e-4058-a24c-9718df558678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7372b52-0f50-4517-840c-c97081a05995", "name": "network-vif-deleted", "tag": "d2dc3936-eb1d-4275-8a23-06d264b2ba89"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:45.828811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-aa7d25d1-7be1-4b05-bbf5-8480a5b30ba9 req-4f3ad62b-2c3e-4058-a24c-9718df558678 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:45.829296 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-aa7d25d1-7be1-4b05-bbf5-8480a5b30ba9 req-4f3ad62b-2c3e-4058-a24c-9718df558678 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:45.829727 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-aa7d25d1-7be1-4b05-bbf5-8480a5b30ba9 req-4f3ad62b-2c3e-4058-a24c-9718df558678 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:45.840970 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-aa7d25d1-7be1-4b05-bbf5-8480a5b30ba9 req-4f3ad62b-2c3e-4058-a24c-9718df558678 service nova] Creating event network-vif-deleted:d2dc3936-eb1d-4275-8a23-06d264b2ba89 for instance f7372b52-0f50-4517-840c-c97081a05995 on hv-cinder-79797 Oct 27 09:40:45.846728 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-aa7d25d1-7be1-4b05-bbf5-8480a5b30ba9 req-4f3ad62b-2c3e-4058-a24c-9718df558678 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Oct 27 09:40:45.847352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 317/640] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:40:46.183180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:46.183802 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:46.191283 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:46.191827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:46.192264 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:46.192999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:46.193453 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:46.193878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:46.224704 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:46.225272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:46.225787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:46.226230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lazy-loading 'fault' on Instance uuid f7372b52-0f50-4517-840c-c97081a05995 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:40:46.267213 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4e4e3b5ce544725b1f4a439596314a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc4fbf213f04cd7ab49abad693a1cf2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:40:46.275067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8025e18d-1c63-41f8-93b7-cf016929941b tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 200 len: 1308 microversion: 2.1 time: 0.095963 Oct 27 09:40:46.275632 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 324/641] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:46 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:40:47.299842 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:40:47.300683 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] [instance: f7372b52-0f50-4517-840c-c97081a05995] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:47.308008 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:47.308490 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:47.308971 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:47.309666 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:47.310118 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:47.310542 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:47.324454 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] HTTP exception thrown: Instance f7372b52-0f50-4517-840c-c97081a05995 could not be found. Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Request method failure captured: Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 HTTP/1.1 Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-_QtU3GtgRW8vzkc0yf0CGO_8K1dq4DRhUgmfhoUIQOCLJkI7Y1bGI1YY7ZNWnbp0itpMW3UVEa9qG-PARp5pS5zKcLZVJgJnpnlDC9lql8lt1iIptll5BcOsGSOGy5q7bKICBdSI_jUiTFh4cWz_mF-0h1oNvXqzoB_DJ7nKry4 Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 9dc4fbf213f04cd7ab49abad693a1cf2 Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-VolumesSnapshotTestJSON-367450342 Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:40:47.326082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9dc4fbf213f04cd7ab49abad693a1cf2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9dc4fbf213f04cd7ab49abad693a1cf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9dc4fbf213f04cd7ab49abad693a1cf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9dc4fbf213f04cd7ab49abad693a1cf2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-VolumesSnapshotTestJSON-367450342 Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 9dc4fbf213f04cd7ab49abad693a1cf2 Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-367450342 Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-VolumesSnapshotTestJSON-367450342-project Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: b4e4e3b5ce544725b1f4a439596314a8 Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-VolumesSnapshotTestJSON-367450342-project Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance f7372b52-0f50-4517-840c-c97081a05995 could not be found. Oct 27 09:40:47.328724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': 'f7372b52-0f50-4517-840c-c97081a05995'} Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7372b52-0f50-4517-840c-c97081a05995 could not be found. Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:40:47.330061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7372b52-0f50-4517-840c-c97081a05995 could not be found. Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7372b52-0f50-4517-840c-c97081a05995 could not be found. Oct 27 09:40:47.332939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:40:47.335091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] Returning 404 to user: Instance f7372b52-0f50-4517-840c-c97081a05995 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:40:47.335091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-894ad0da-d689-4692-b923-d5395d9bb7c0 tempest-VolumesSnapshotTestJSON-367450342 tempest-VolumesSnapshotTestJSON-367450342-project] 10.222.0.70 "GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995" status: 404 len: 111 microversion: 2.1 time: 0.032672 Oct 27 09:40:47.335091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 318/642] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:40:47 2022] GET /compute/v2.1/servers/f7372b52-0f50-4517-840c-c97081a05995 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:40:48.391250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-96c0c38d-f0f8-45f3-ae65-d79985ff7b7e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c94c5a3-ef45-4079-98ad-2a7e7630cdf4"}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:40:48.393686 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-96c0c38d-f0f8-45f3-ae65-d79985ff7b7e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:40:48.400533 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-96c0c38d-f0f8-45f3-ae65-d79985ff7b7e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:48.401040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-96c0c38d-f0f8-45f3-ae65-d79985ff7b7e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:48.401474 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-96c0c38d-f0f8-45f3-ae65-d79985ff7b7e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:48.402157 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-96c0c38d-f0f8-45f3-ae65-d79985ff7b7e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:40:48.402606 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-96c0c38d-f0f8-45f3-ae65-d79985ff7b7e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:40:48.403028 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-96c0c38d-f0f8-45f3-ae65-d79985ff7b7e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:40:48.477338 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:40:48.656683 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-96c0c38d-f0f8-45f3-ae65-d79985ff7b7e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269137 Oct 27 09:40:48.657320 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 325/643] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:40:48 2022] POST /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:01.515207 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7a6b2015-7369-4e0c-ac7a-d7b21cdef95c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:01.517392 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7a6b2015-7369-4e0c-ac7a-d7b21cdef95c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:01.520078 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:01.520750 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:01.527291 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7a6b2015-7369-4e0c-ac7a-d7b21cdef95c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.527767 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7a6b2015-7369-4e0c-ac7a-d7b21cdef95c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.528197 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7a6b2015-7369-4e0c-ac7a-d7b21cdef95c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.528923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7a6b2015-7369-4e0c-ac7a-d7b21cdef95c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.529367 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7a6b2015-7369-4e0c-ac7a-d7b21cdef95c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.529830 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7a6b2015-7369-4e0c-ac7a-d7b21cdef95c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.554880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-7a6b2015-7369-4e0c-ac7a-d7b21cdef95c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lazy-loading 'flavor' on Instance uuid d2612979-fbed-42ac-b725-265018416862 {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:41:01.610437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=9 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:01.611385 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:01.615266 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-df6f18ca-9624-4b1b-bfa6-0d3a02384b7e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:01.618444 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-df6f18ca-9624-4b1b-bfa6-0d3a02384b7e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:01.625778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-df6f18ca-9624-4b1b-bfa6-0d3a02384b7e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.626258 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-df6f18ca-9624-4b1b-bfa6-0d3a02384b7e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.626684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-df6f18ca-9624-4b1b-bfa6-0d3a02384b7e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.627420 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-df6f18ca-9624-4b1b-bfa6-0d3a02384b7e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.627865 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-df6f18ca-9624-4b1b-bfa6-0d3a02384b7e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.628279 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-df6f18ca-9624-4b1b-bfa6-0d3a02384b7e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.679376 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7a6b2015-7369-4e0c-ac7a-d7b21cdef95c tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/action" status: 200 len: 32 microversion: 2.1 time: 0.167991 Oct 27 09:41:01.679902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 319/644] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:41:01 2022] POST /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:41:01.689682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-bb73ff7b-4f30-49ac-abbd-d3a414aef9c5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:01.690397 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-bb73ff7b-4f30-49ac-abbd-d3a414aef9c5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:01.697769 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb73ff7b-4f30-49ac-abbd-d3a414aef9c5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.698086 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb73ff7b-4f30-49ac-abbd-d3a414aef9c5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.698547 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb73ff7b-4f30-49ac-abbd-d3a414aef9c5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.699339 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb73ff7b-4f30-49ac-abbd-d3a414aef9c5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.699804 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb73ff7b-4f30-49ac-abbd-d3a414aef9c5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.700281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-bb73ff7b-4f30-49ac-abbd-d3a414aef9c5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.707590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-df6f18ca-9624-4b1b-bfa6-0d3a02384b7e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "POST /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/action" status: 202 len: 0 microversion: 2.1 time: 0.098469 Oct 27 09:41:01.708438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 326/645] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:41:01 2022] POST /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:41:01.716510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-03edd389-a497-4fbe-b864-dc67a762efcd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:01.717321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-03edd389-a497-4fbe-b864-dc67a762efcd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:01.723640 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-03edd389-a497-4fbe-b864-dc67a762efcd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.724214 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-03edd389-a497-4fbe-b864-dc67a762efcd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.724765 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-03edd389-a497-4fbe-b864-dc67a762efcd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:01.725530 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-03edd389-a497-4fbe-b864-dc67a762efcd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:01.726046 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-03edd389-a497-4fbe-b864-dc67a762efcd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:01.726530 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-03edd389-a497-4fbe-b864-dc67a762efcd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:02.107905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-bb73ff7b-4f30-49ac-abbd-d3a414aef9c5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:02.117234 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-bb73ff7b-4f30-49ac-abbd-d3a414aef9c5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.431617 Oct 27 09:41:02.117996 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 320/646] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:01 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:02.142610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-03edd389-a497-4fbe-b864-dc67a762efcd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:02.150759 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-03edd389-a497-4fbe-b864-dc67a762efcd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1752 microversion: 2.1 time: 0.438119 Oct 27 09:41:02.151323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 327/647] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:01 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1752 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:03.140480 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8ef7d971-bcf1-4d05-963b-67c2e92d67f1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:03.141122 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8ef7d971-bcf1-4d05-963b-67c2e92d67f1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:03.147488 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ef7d971-bcf1-4d05-963b-67c2e92d67f1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:03.147970 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ef7d971-bcf1-4d05-963b-67c2e92d67f1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:03.148418 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ef7d971-bcf1-4d05-963b-67c2e92d67f1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:03.149144 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ef7d971-bcf1-4d05-963b-67c2e92d67f1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:03.149601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ef7d971-bcf1-4d05-963b-67c2e92d67f1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:03.150022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8ef7d971-bcf1-4d05-963b-67c2e92d67f1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:03.174901 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-408c070b-28aa-4439-9019-6b8ad3f77894 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:03.175420 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-408c070b-28aa-4439-9019-6b8ad3f77894 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:03.182439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-408c070b-28aa-4439-9019-6b8ad3f77894 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:03.182924 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-408c070b-28aa-4439-9019-6b8ad3f77894 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:03.183360 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-408c070b-28aa-4439-9019-6b8ad3f77894 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:03.184062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-408c070b-28aa-4439-9019-6b8ad3f77894 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:03.184538 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-408c070b-28aa-4439-9019-6b8ad3f77894 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:03.184957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-408c070b-28aa-4439-9019-6b8ad3f77894 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:03.555914 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8ef7d971-bcf1-4d05-963b-67c2e92d67f1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:03.564071 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8ef7d971-bcf1-4d05-963b-67c2e92d67f1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.427492 Oct 27 09:41:03.564759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 321/648] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:03 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:03.590021 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-408c070b-28aa-4439-9019-6b8ad3f77894 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:03.598189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-408c070b-28aa-4439-9019-6b8ad3f77894 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.427229 Oct 27 09:41:03.598754 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 328/649] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:03 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:04.587695 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a4bd408e-12aa-4b97-acd2-1dae277164d4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:04.588304 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a4bd408e-12aa-4b97-acd2-1dae277164d4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:04.594408 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4bd408e-12aa-4b97-acd2-1dae277164d4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:04.594892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4bd408e-12aa-4b97-acd2-1dae277164d4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:04.595328 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4bd408e-12aa-4b97-acd2-1dae277164d4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:04.596012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4bd408e-12aa-4b97-acd2-1dae277164d4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:04.596465 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4bd408e-12aa-4b97-acd2-1dae277164d4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:04.596916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4bd408e-12aa-4b97-acd2-1dae277164d4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:04.622825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-20dcf0ec-8c9b-4f43-91c6-b342d7ac310e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:04.624046 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-20dcf0ec-8c9b-4f43-91c6-b342d7ac310e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:04.630493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-20dcf0ec-8c9b-4f43-91c6-b342d7ac310e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:04.631000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-20dcf0ec-8c9b-4f43-91c6-b342d7ac310e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:04.631416 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-20dcf0ec-8c9b-4f43-91c6-b342d7ac310e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:04.632112 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-20dcf0ec-8c9b-4f43-91c6-b342d7ac310e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:04.632590 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-20dcf0ec-8c9b-4f43-91c6-b342d7ac310e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:04.633024 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-20dcf0ec-8c9b-4f43-91c6-b342d7ac310e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:04.776601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a4bd408e-12aa-4b97-acd2-1dae277164d4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:04.785676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a4bd408e-12aa-4b97-acd2-1dae277164d4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.201825 Oct 27 09:41:04.800883 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 322/650] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:04 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:04.816391 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-20dcf0ec-8c9b-4f43-91c6-b342d7ac310e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:04.824724 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-20dcf0ec-8c9b-4f43-91c6-b342d7ac310e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.205657 Oct 27 09:41:04.825295 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 329/651] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:04 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:05.808915 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-46aa762d-f3d1-4baf-b97d-ca44e68abd75 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:05.809533 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-46aa762d-f3d1-4baf-b97d-ca44e68abd75 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:05.815946 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46aa762d-f3d1-4baf-b97d-ca44e68abd75 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:05.816424 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46aa762d-f3d1-4baf-b97d-ca44e68abd75 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:05.816895 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46aa762d-f3d1-4baf-b97d-ca44e68abd75 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:05.817592 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46aa762d-f3d1-4baf-b97d-ca44e68abd75 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:05.818050 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46aa762d-f3d1-4baf-b97d-ca44e68abd75 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:05.818479 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46aa762d-f3d1-4baf-b97d-ca44e68abd75 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:05.849179 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4a6242ce-c561-4a9e-bfd9-f2d45fe3435e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:05.849809 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4a6242ce-c561-4a9e-bfd9-f2d45fe3435e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:05.856783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a6242ce-c561-4a9e-bfd9-f2d45fe3435e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:05.857261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a6242ce-c561-4a9e-bfd9-f2d45fe3435e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:05.857687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a6242ce-c561-4a9e-bfd9-f2d45fe3435e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:05.858371 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a6242ce-c561-4a9e-bfd9-f2d45fe3435e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:05.858813 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a6242ce-c561-4a9e-bfd9-f2d45fe3435e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:05.859231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4a6242ce-c561-4a9e-bfd9-f2d45fe3435e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:06.000340 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-46aa762d-f3d1-4baf-b97d-ca44e68abd75 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:06.010229 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-46aa762d-f3d1-4baf-b97d-ca44e68abd75 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.205809 Oct 27 09:41:06.010813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 323/652] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:05 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:06.048218 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4a6242ce-c561-4a9e-bfd9-f2d45fe3435e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:06.056580 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4a6242ce-c561-4a9e-bfd9-f2d45fe3435e tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.211213 Oct 27 09:41:06.057150 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 330/653] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:05 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:07.033778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f476c8eb-2dbd-464f-9f82-59516297f724 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:07.034415 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f476c8eb-2dbd-464f-9f82-59516297f724 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:07.041777 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f476c8eb-2dbd-464f-9f82-59516297f724 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:07.042338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f476c8eb-2dbd-464f-9f82-59516297f724 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:07.042775 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f476c8eb-2dbd-464f-9f82-59516297f724 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:07.043494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f476c8eb-2dbd-464f-9f82-59516297f724 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:07.043908 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f476c8eb-2dbd-464f-9f82-59516297f724 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:07.044408 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f476c8eb-2dbd-464f-9f82-59516297f724 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:07.079727 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-bca76cec-2374-4e9d-b0ba-96c365964bca tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:07.080346 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-bca76cec-2374-4e9d-b0ba-96c365964bca tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:07.087314 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bca76cec-2374-4e9d-b0ba-96c365964bca tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:07.087818 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bca76cec-2374-4e9d-b0ba-96c365964bca tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:07.088273 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bca76cec-2374-4e9d-b0ba-96c365964bca tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:07.089210 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bca76cec-2374-4e9d-b0ba-96c365964bca tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:07.089668 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bca76cec-2374-4e9d-b0ba-96c365964bca tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:07.090267 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bca76cec-2374-4e9d-b0ba-96c365964bca tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:07.249396 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f476c8eb-2dbd-464f-9f82-59516297f724 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:07.257600 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f476c8eb-2dbd-464f-9f82-59516297f724 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.227613 Oct 27 09:41:07.258181 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 324/654] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:07 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:07.284009 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bca76cec-2374-4e9d-b0ba-96c365964bca tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:07.293239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-bca76cec-2374-4e9d-b0ba-96c365964bca tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.217505 Oct 27 09:41:07.293809 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 331/655] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:07 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:08.280915 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1a10113f-c12c-46eb-9505-b2ece86adacf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:08.281793 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1a10113f-c12c-46eb-9505-b2ece86adacf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:08.292486 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a10113f-c12c-46eb-9505-b2ece86adacf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:08.293067 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a10113f-c12c-46eb-9505-b2ece86adacf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:08.293588 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a10113f-c12c-46eb-9505-b2ece86adacf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:08.294362 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a10113f-c12c-46eb-9505-b2ece86adacf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:08.294892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a10113f-c12c-46eb-9505-b2ece86adacf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:08.295387 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a10113f-c12c-46eb-9505-b2ece86adacf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:08.316967 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d9107804-293b-48a5-8d77-3c8d3e17cbab tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:08.317583 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d9107804-293b-48a5-8d77-3c8d3e17cbab tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:08.324293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d9107804-293b-48a5-8d77-3c8d3e17cbab tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:08.324293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d9107804-293b-48a5-8d77-3c8d3e17cbab tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:08.327363 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d9107804-293b-48a5-8d77-3c8d3e17cbab tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:08.328260 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d9107804-293b-48a5-8d77-3c8d3e17cbab tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:08.328765 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d9107804-293b-48a5-8d77-3c8d3e17cbab tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:08.329202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d9107804-293b-48a5-8d77-3c8d3e17cbab tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:08.500463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1a10113f-c12c-46eb-9505-b2ece86adacf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:08.509355 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1a10113f-c12c-46eb-9505-b2ece86adacf tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.232304 Oct 27 09:41:08.509924 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 325/656] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:08 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:08.528463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d9107804-293b-48a5-8d77-3c8d3e17cbab tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:08.536671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d9107804-293b-48a5-8d77-3c8d3e17cbab tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.223500 Oct 27 09:41:08.537237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 332/657] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:08 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:09.531939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-65be37f0-9800-43d2-b56e-1de1bedebd9e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:09.532609 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-65be37f0-9800-43d2-b56e-1de1bedebd9e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:09.539593 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65be37f0-9800-43d2-b56e-1de1bedebd9e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:09.540084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65be37f0-9800-43d2-b56e-1de1bedebd9e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:09.541307 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65be37f0-9800-43d2-b56e-1de1bedebd9e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:09.541975 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65be37f0-9800-43d2-b56e-1de1bedebd9e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:09.542437 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65be37f0-9800-43d2-b56e-1de1bedebd9e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:09.542864 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-65be37f0-9800-43d2-b56e-1de1bedebd9e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:09.568752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-12bed7c2-f980-4a6f-bbc1-c9101750621f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:09.568752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-12bed7c2-f980-4a6f-bbc1-c9101750621f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:09.568752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-12bed7c2-f980-4a6f-bbc1-c9101750621f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:09.568752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-12bed7c2-f980-4a6f-bbc1-c9101750621f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:09.569457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-12bed7c2-f980-4a6f-bbc1-c9101750621f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:09.569562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-12bed7c2-f980-4a6f-bbc1-c9101750621f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:09.569977 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-12bed7c2-f980-4a6f-bbc1-c9101750621f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:09.570396 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-12bed7c2-f980-4a6f-bbc1-c9101750621f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:09.737413 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-65be37f0-9800-43d2-b56e-1de1bedebd9e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:09.745611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-65be37f0-9800-43d2-b56e-1de1bedebd9e tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.217483 Oct 27 09:41:09.746335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 326/658] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:09 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:09.757741 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-12bed7c2-f980-4a6f-bbc1-c9101750621f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:09.766278 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-12bed7c2-f980-4a6f-bbc1-c9101750621f tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.210190 Oct 27 09:41:09.766825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 333/659] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:09 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:10.722324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-aac7886c-13be-47fa-9864-706e86b59c5b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:10.723510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-aac7886c-13be-47fa-9864-706e86b59c5b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:10.732042 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aac7886c-13be-47fa-9864-706e86b59c5b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.732556 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aac7886c-13be-47fa-9864-706e86b59c5b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.733002 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aac7886c-13be-47fa-9864-706e86b59c5b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.733713 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aac7886c-13be-47fa-9864-706e86b59c5b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.734167 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aac7886c-13be-47fa-9864-706e86b59c5b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.734590 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aac7886c-13be-47fa-9864-706e86b59c5b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.769651 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-aac7886c-13be-47fa-9864-706e86b59c5b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-volume_attachments/4fcc1572-3193-486f-9cb6-c72864576d76" status: 200 len: 194 microversion: 2.20 time: 0.056785 Oct 27 09:41:10.770859 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 327/660] 10.222.0.70 () {60 vars in 1454 bytes} [Thu Oct 27 09:41:10 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-volume_attachments/4fcc1572-3193-486f-9cb6-c72864576d76 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:41:10.773251 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-776aeb8f-2164-4f79-9662-46dcc2ea3191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:10.774538 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-776aeb8f-2164-4f79-9662-46dcc2ea3191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:10.782468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-776aeb8f-2164-4f79-9662-46dcc2ea3191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.783118 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-776aeb8f-2164-4f79-9662-46dcc2ea3191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.783563 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-776aeb8f-2164-4f79-9662-46dcc2ea3191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.784766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-776aeb8f-2164-4f79-9662-46dcc2ea3191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.785231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-776aeb8f-2164-4f79-9662-46dcc2ea3191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.785663 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-776aeb8f-2164-4f79-9662-46dcc2ea3191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.792360 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-34726953-99f1-4a4d-98c7-7b29202785a6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:10.793022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-34726953-99f1-4a4d-98c7-7b29202785a6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:10.799632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34726953-99f1-4a4d-98c7-7b29202785a6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.800430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34726953-99f1-4a4d-98c7-7b29202785a6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.800952 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34726953-99f1-4a4d-98c7-7b29202785a6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.801931 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34726953-99f1-4a4d-98c7-7b29202785a6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:10.802402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34726953-99f1-4a4d-98c7-7b29202785a6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:10.802868 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-34726953-99f1-4a4d-98c7-7b29202785a6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:10.996702 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-776aeb8f-2164-4f79-9662-46dcc2ea3191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:11.005223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-776aeb8f-2164-4f79-9662-46dcc2ea3191 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.236305 Oct 27 09:41:11.005936 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 334/661] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:10 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:11.011309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b64c5160-5967-4d50-9fb2-dbcd6836f553 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:11.011977 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b64c5160-5967-4d50-9fb2-dbcd6836f553 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:11.017867 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b64c5160-5967-4d50-9fb2-dbcd6836f553 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:11.018626 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b64c5160-5967-4d50-9fb2-dbcd6836f553 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:11.019164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b64c5160-5967-4d50-9fb2-dbcd6836f553 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:11.020164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b64c5160-5967-4d50-9fb2-dbcd6836f553 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:11.020915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b64c5160-5967-4d50-9fb2-dbcd6836f553 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:11.021500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b64c5160-5967-4d50-9fb2-dbcd6836f553 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:11.030337 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-34726953-99f1-4a4d-98c7-7b29202785a6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:11.040463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-34726953-99f1-4a4d-98c7-7b29202785a6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.254693 Oct 27 09:41:11.060133 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 328/662] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:10 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:11.128399 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-b64c5160-5967-4d50-9fb2-dbcd6836f553 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lazy-loading 'services' on Instance uuid 8ac6a130-38c4-4843-b9a8-118d25c11c18 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:41:11.208389 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b64c5160-5967-4d50-9fb2-dbcd6836f553 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-volume_attachments/4fcc1572-3193-486f-9cb6-c72864576d76" status: 202 len: 0 microversion: 2.20 time: 0.200933 Oct 27 09:41:11.209301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 335/663] 10.222.0.70 () {60 vars in 1457 bytes} [Thu Oct 27 09:41:11 2022] DELETE /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-volume_attachments/4fcc1572-3193-486f-9cb6-c72864576d76 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:41:11.217888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-639678b4-535d-438c-b83b-afe666473312 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:11.220114 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-639678b4-535d-438c-b83b-afe666473312 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:11.236236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-639678b4-535d-438c-b83b-afe666473312 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:11.236797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-639678b4-535d-438c-b83b-afe666473312 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:11.237425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-639678b4-535d-438c-b83b-afe666473312 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:11.238291 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-639678b4-535d-438c-b83b-afe666473312 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:11.238896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-639678b4-535d-438c-b83b-afe666473312 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:11.239514 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-639678b4-535d-438c-b83b-afe666473312 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:11.279453 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-639678b4-535d-438c-b83b-afe666473312 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065953 Oct 27 09:41:11.280020 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 329/664] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Oct 27 09:41:11 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:41:12.031107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ebdce796-7ac7-4da2-87b3-9fa9832ac8b8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:12.031803 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ebdce796-7ac7-4da2-87b3-9fa9832ac8b8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:12.037910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebdce796-7ac7-4da2-87b3-9fa9832ac8b8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.038753 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebdce796-7ac7-4da2-87b3-9fa9832ac8b8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.039323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebdce796-7ac7-4da2-87b3-9fa9832ac8b8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.040179 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebdce796-7ac7-4da2-87b3-9fa9832ac8b8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.040699 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebdce796-7ac7-4da2-87b3-9fa9832ac8b8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.041838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebdce796-7ac7-4da2-87b3-9fa9832ac8b8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.069548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-684f1545-157d-443f-a04f-361b757e1228 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:12.070234 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-684f1545-157d-443f-a04f-361b757e1228 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:12.078718 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-684f1545-157d-443f-a04f-361b757e1228 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.079223 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-684f1545-157d-443f-a04f-361b757e1228 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.080123 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-684f1545-157d-443f-a04f-361b757e1228 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.080867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-684f1545-157d-443f-a04f-361b757e1228 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.081304 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-684f1545-157d-443f-a04f-361b757e1228 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.081729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-684f1545-157d-443f-a04f-361b757e1228 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.233915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ebdce796-7ac7-4da2-87b3-9fa9832ac8b8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:12.242168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ebdce796-7ac7-4da2-87b3-9fa9832ac8b8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.216338 Oct 27 09:41:12.242740 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 336/665] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:12 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:12.274767 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-684f1545-157d-443f-a04f-361b757e1228 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:12.283559 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-684f1545-157d-443f-a04f-361b757e1228 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.218332 Oct 27 09:41:12.284116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 330/666] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:12 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:12.293625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-909549b7-19bb-4a75-9652-512379182e74 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:12.296003 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-909549b7-19bb-4a75-9652-512379182e74 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:12.302056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-909549b7-19bb-4a75-9652-512379182e74 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.302556 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-909549b7-19bb-4a75-9652-512379182e74 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.302990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-909549b7-19bb-4a75-9652-512379182e74 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.303670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-909549b7-19bb-4a75-9652-512379182e74 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.304119 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-909549b7-19bb-4a75-9652-512379182e74 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.304562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-909549b7-19bb-4a75-9652-512379182e74 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.333694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-909549b7-19bb-4a75-9652-512379182e74 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044617 Oct 27 09:41:12.334270 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 337/667] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Oct 27 09:41:12 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:12.401188 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c6cbdbca-1c11-4897-92d8-4d09ffffd81f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:12.401693 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c6cbdbca-1c11-4897-92d8-4d09ffffd81f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:12.407578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6cbdbca-1c11-4897-92d8-4d09ffffd81f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.408089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6cbdbca-1c11-4897-92d8-4d09ffffd81f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.408555 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6cbdbca-1c11-4897-92d8-4d09ffffd81f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.409249 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6cbdbca-1c11-4897-92d8-4d09ffffd81f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.409740 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6cbdbca-1c11-4897-92d8-4d09ffffd81f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.410168 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c6cbdbca-1c11-4897-92d8-4d09ffffd81f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.434539 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c6cbdbca-1c11-4897-92d8-4d09ffffd81f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:41:12.483127 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:12.509047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c6cbdbca-1c11-4897-92d8-4d09ffffd81f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 204 len: 0 microversion: 2.20 time: 0.111997 Oct 27 09:41:12.509623 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 331/668] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Oct 27 09:41:12 2022] DELETE /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:41:12.519012 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:12.519626 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:12.525465 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.526532 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.526969 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.527655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:12.528110 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:12.528570 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:12.654988 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:12.662939 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:12.664349 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:12.665515 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-04b02271-d46d-4880-a84b-0fb911a48495 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.150734 Oct 27 09:41:12.666067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 338/669] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:12 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:13.265741 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-85cd1a22-9f56-4e48-a0f0-a0a7e474819b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:13.266443 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-85cd1a22-9f56-4e48-a0f0-a0a7e474819b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:13.273137 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85cd1a22-9f56-4e48-a0f0-a0a7e474819b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:13.273624 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85cd1a22-9f56-4e48-a0f0-a0a7e474819b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:13.274056 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85cd1a22-9f56-4e48-a0f0-a0a7e474819b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:13.274748 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85cd1a22-9f56-4e48-a0f0-a0a7e474819b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:13.275195 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85cd1a22-9f56-4e48-a0f0-a0a7e474819b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:13.275619 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-85cd1a22-9f56-4e48-a0f0-a0a7e474819b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:13.307649 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ca3ef4b3-a777-4619-b14a-f0f54b91ad4c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:13.308290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ca3ef4b3-a777-4619-b14a-f0f54b91ad4c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:13.314829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca3ef4b3-a777-4619-b14a-f0f54b91ad4c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:13.315313 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca3ef4b3-a777-4619-b14a-f0f54b91ad4c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:13.315749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca3ef4b3-a777-4619-b14a-f0f54b91ad4c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:13.316442 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca3ef4b3-a777-4619-b14a-f0f54b91ad4c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:13.316921 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca3ef4b3-a777-4619-b14a-f0f54b91ad4c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:13.317345 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca3ef4b3-a777-4619-b14a-f0f54b91ad4c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:13.462776 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-85cd1a22-9f56-4e48-a0f0-a0a7e474819b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:13.471471 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-85cd1a22-9f56-4e48-a0f0-a0a7e474819b tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.209957 Oct 27 09:41:13.472041 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 332/670] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:13 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:13.499548 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ca3ef4b3-a777-4619-b14a-f0f54b91ad4c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:13.507763 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ca3ef4b3-a777-4619-b14a-f0f54b91ad4c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.204545 Oct 27 09:41:13.508327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 339/671] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:13 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:13.691973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:13.692593 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:13.698449 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:13.698920 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:13.699348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:13.700025 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:13.700472 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:13.700913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:13.827953 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:13.836205 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:13.837929 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:13.839093 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0be4d1f9-05af-4ea7-bc22-0377b659a1e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.150962 Oct 27 09:41:13.839647 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 333/672] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:13 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:14.495799 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d132c155-2982-4e47-83e3-06a2688f69ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:14.496407 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d132c155-2982-4e47-83e3-06a2688f69ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:14.502870 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d132c155-2982-4e47-83e3-06a2688f69ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:14.503355 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d132c155-2982-4e47-83e3-06a2688f69ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:14.503794 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d132c155-2982-4e47-83e3-06a2688f69ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:14.504481 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d132c155-2982-4e47-83e3-06a2688f69ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:14.504963 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d132c155-2982-4e47-83e3-06a2688f69ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:14.505380 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d132c155-2982-4e47-83e3-06a2688f69ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:14.531386 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f798f8fb-2499-4c9b-baa8-97a8b54ce8a5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:14.532328 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f798f8fb-2499-4c9b-baa8-97a8b54ce8a5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:14.542527 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f798f8fb-2499-4c9b-baa8-97a8b54ce8a5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:14.542961 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f798f8fb-2499-4c9b-baa8-97a8b54ce8a5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:14.543399 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f798f8fb-2499-4c9b-baa8-97a8b54ce8a5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:14.544110 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f798f8fb-2499-4c9b-baa8-97a8b54ce8a5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:14.544591 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f798f8fb-2499-4c9b-baa8-97a8b54ce8a5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:14.545021 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f798f8fb-2499-4c9b-baa8-97a8b54ce8a5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:14.824779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d132c155-2982-4e47-83e3-06a2688f69ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:14.828500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:14.834262 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d132c155-2982-4e47-83e3-06a2688f69ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.342289 Oct 27 09:41:14.834839 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 340/673] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:14 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:14.860543 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f798f8fb-2499-4c9b-baa8-97a8b54ce8a5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:14.865584 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:14.866271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:14.868965 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f798f8fb-2499-4c9b-baa8-97a8b54ce8a5 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.341339 Oct 27 09:41:14.874300 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 334/674] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:14 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:14.874472 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:14.874472 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:14.874472 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:14.874934 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:14.875415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:14.875847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:15.139512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:15.147614 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:15.149099 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:15.150271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cba5d862-5cc3-4627-8547-756834d0f7d9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1723 microversion: 2.20 time: 0.289171 Oct 27 09:41:15.150838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 341/675] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:14 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:41:15.571175 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-e6099b4f-1755-4eb9-af30-09963556221f req-96338650-1998-4a30-9090-b737fbc6d62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac6a130-38c4-4843-b9a8-118d25c11c18", "name": "network-vif-deleted", "tag": "0e6b0478-48aa-4f67-86d8-eb4b392e3971"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:15.583763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-e6099b4f-1755-4eb9-af30-09963556221f req-96338650-1998-4a30-9090-b737fbc6d62e service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:15.585230 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-e6099b4f-1755-4eb9-af30-09963556221f req-96338650-1998-4a30-9090-b737fbc6d62e service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:15.585846 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-e6099b4f-1755-4eb9-af30-09963556221f req-96338650-1998-4a30-9090-b737fbc6d62e service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:15.599416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-e6099b4f-1755-4eb9-af30-09963556221f req-96338650-1998-4a30-9090-b737fbc6d62e service nova] Creating event network-vif-deleted:0e6b0478-48aa-4f67-86d8-eb4b392e3971 for instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 on hv-cinder-79797 Oct 27 09:41:15.607030 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-e6099b4f-1755-4eb9-af30-09963556221f req-96338650-1998-4a30-9090-b737fbc6d62e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039726 Oct 27 09:41:15.608050 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 335/676] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:15.857954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3bc9e07d-4572-42df-a763-222a211c4497 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:15.858562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3bc9e07d-4572-42df-a763-222a211c4497 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:15.864754 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3bc9e07d-4572-42df-a763-222a211c4497 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:15.865230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3bc9e07d-4572-42df-a763-222a211c4497 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:15.865657 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3bc9e07d-4572-42df-a763-222a211c4497 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:15.866335 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3bc9e07d-4572-42df-a763-222a211c4497 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:15.866830 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3bc9e07d-4572-42df-a763-222a211c4497 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:15.867187 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3bc9e07d-4572-42df-a763-222a211c4497 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:15.895671 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-da08aa36-ec2c-4bf2-8f3f-546c593f19dd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:15.896622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-da08aa36-ec2c-4bf2-8f3f-546c593f19dd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:15.918931 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da08aa36-ec2c-4bf2-8f3f-546c593f19dd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:15.918931 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da08aa36-ec2c-4bf2-8f3f-546c593f19dd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:15.918931 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da08aa36-ec2c-4bf2-8f3f-546c593f19dd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:15.919493 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da08aa36-ec2c-4bf2-8f3f-546c593f19dd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:15.919962 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da08aa36-ec2c-4bf2-8f3f-546c593f19dd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:15.920392 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da08aa36-ec2c-4bf2-8f3f-546c593f19dd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:16.093237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3bc9e07d-4572-42df-a763-222a211c4497 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:16.104617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3bc9e07d-4572-42df-a763-222a211c4497 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.250310 Oct 27 09:41:16.121241 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 342/677] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:15 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:16.146998 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-da08aa36-ec2c-4bf2-8f3f-546c593f19dd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:16.155980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-da08aa36-ec2c-4bf2-8f3f-546c593f19dd tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.266277 Oct 27 09:41:16.156570 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 336/678] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:15 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:16.175135 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:16.176008 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:16.182639 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:16.183314 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:16.183923 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:16.184698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:16.185313 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:16.185894 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:16.218319 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:16.218804 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:16.219253 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:16.219699 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lazy-loading 'fault' on Instance uuid 8ac6a130-38c4-4843-b9a8-118d25c11c18 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:41:16.260766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:16.269007 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:16.270448 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:16.271821 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-eef78372-8894-4b30-8fd2-c3779e3a23d0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 200 len: 1371 microversion: 2.20 time: 0.100551 Oct 27 09:41:16.272564 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 343/679] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:16 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:17.130206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-aa9a9128-563d-4677-9f21-08efbb603847 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:17.130819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-aa9a9128-563d-4677-9f21-08efbb603847 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:17.137839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aa9a9128-563d-4677-9f21-08efbb603847 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:17.138326 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aa9a9128-563d-4677-9f21-08efbb603847 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:17.138763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aa9a9128-563d-4677-9f21-08efbb603847 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:17.139460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aa9a9128-563d-4677-9f21-08efbb603847 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:17.139912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aa9a9128-563d-4677-9f21-08efbb603847 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:17.140334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-aa9a9128-563d-4677-9f21-08efbb603847 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:17.178927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-199eadae-f441-4566-a0b2-c8b09d293195 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:17.179545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-199eadae-f441-4566-a0b2-c8b09d293195 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:17.186187 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-199eadae-f441-4566-a0b2-c8b09d293195 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:17.186673 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-199eadae-f441-4566-a0b2-c8b09d293195 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:17.187110 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-199eadae-f441-4566-a0b2-c8b09d293195 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:17.187812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-199eadae-f441-4566-a0b2-c8b09d293195 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:17.188261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-199eadae-f441-4566-a0b2-c8b09d293195 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:17.188711 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-199eadae-f441-4566-a0b2-c8b09d293195 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:17.326431 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-aa9a9128-563d-4677-9f21-08efbb603847 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:17.334797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-aa9a9128-563d-4677-9f21-08efbb603847 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.208460 Oct 27 09:41:17.349196 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 337/680] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:17 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:17.357020 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:17.357716 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:17.366393 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:17.367201 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:17.367806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:17.368931 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:17.370394 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:17.371020 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:17.376234 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-199eadae-f441-4566-a0b2-c8b09d293195 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:17.385858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-199eadae-f441-4566-a0b2-c8b09d293195 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.209947 Oct 27 09:41:17.386470 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 344/681] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:17 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:17.389836 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] HTTP exception thrown: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Request method failure captured: Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 HTTP/1.1 Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEqDAZ0WOPSJQHLbzCfBKonOTdJr4ebFmKuYZxLtASiT0N19OEBmy3Fo5qOTF32fRyiaWgqQc3-vTSqDEM3-aezufEddk4PUlBAx7pt2E5nYzglmBliNG2K0T1OMMJeJs0l56HO5hErbW2w_wjPGla8OXnEkrtQ5YGj-3f24cw9LVU Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:41:17.391765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 2dea51c29cbd46e8bd1454e10eaac012 Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:41:17.393206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '8ac6a130-38c4-4843-b9a8-118d25c11c18'} Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:41:17.393988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:41:17.395169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:17.396244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Returning 404 to user: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:41:17.396244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d6dc992e-2f51-443e-9553-925090d65456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 404 len: 111 microversion: 2.20 time: 0.042758 Oct 27 09:41:17.396244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 338/682] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:17 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:41:17.403038 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-47919976-8555-44d9-bd99-c9e789f8179a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '.version_select at 0x7f364932c790>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:17.425019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-47919976-8555-44d9-bd99-c9e789f8179a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464429464" status: 204 len: 0 microversion: 2.20 time: 0.026142 Oct 27 09:41:17.425609 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 345/683] 10.222.0.70 () {60 vars in 1262 bytes} [Thu Oct 27 09:41:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1464429464 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 09:41:18.290097 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3f0f3bc6-0624-43e1-bd47-17797003b519 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Action: 'create', calling method: .version_select at 0x7f36491c04c0>, body: {"keypair": {"name": "tempest-keypair-43850174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSmv3TllXiNs+/0JRK7fQI5j8z7eWKcleDM8Xty7vXzrZjjWDrKrP5Y0TwBYHncvz2zBcN/IADniPFtjqHDl3yBo0qLfmFSueDKguT8vBtU2aBoykxxMX9wBlyKDrLNUQ=="}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:18.307273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-3f0f3bc6-0624-43e1-bd47-17797003b519 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Getting quotas for project 7295248456c446bbb3f7d2d5953c9360. Resources: {'key_pairs'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:41:18.311086 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-3f0f3bc6-0624-43e1-bd47-17797003b519 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Getting quotas for user 2dea51c29cbd46e8bd1454e10eaac012 and project 7295248456c446bbb3f7d2d5953c9360. Resources: {'key_pairs'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:41:18.333290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3f0f3bc6-0624-43e1-bd47-17797003b519 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.047110 Oct 27 09:41:18.333878 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 339/684] 10.222.0.70 () {62 vars in 1200 bytes} [Thu Oct 27 09:41:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 09:41:18.363245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-731a1c06-85d7-48bf-a9be-49a80fda6c24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:18.363916 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-731a1c06-85d7-48bf-a9be-49a80fda6c24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:18.371837 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-731a1c06-85d7-48bf-a9be-49a80fda6c24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:18.372357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-731a1c06-85d7-48bf-a9be-49a80fda6c24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:18.372814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-731a1c06-85d7-48bf-a9be-49a80fda6c24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:18.373512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-731a1c06-85d7-48bf-a9be-49a80fda6c24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:18.373963 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-731a1c06-85d7-48bf-a9be-49a80fda6c24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:18.374550 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-731a1c06-85d7-48bf-a9be-49a80fda6c24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:18.409835 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c5447348-9974-4c78-9135-3d9b21f6903b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:18.410462 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c5447348-9974-4c78-9135-3d9b21f6903b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:18.418022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c5447348-9974-4c78-9135-3d9b21f6903b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:18.418628 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c5447348-9974-4c78-9135-3d9b21f6903b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:18.419323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c5447348-9974-4c78-9135-3d9b21f6903b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:18.420076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c5447348-9974-4c78-9135-3d9b21f6903b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:18.420682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c5447348-9974-4c78-9135-3d9b21f6903b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:18.421104 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c5447348-9974-4c78-9135-3d9b21f6903b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:18.621236 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-731a1c06-85d7-48bf-a9be-49a80fda6c24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:18.633289 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-731a1c06-85d7-48bf-a9be-49a80fda6c24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.274795 Oct 27 09:41:18.635042 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 346/685] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:18 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:18.661924 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c5447348-9974-4c78-9135-3d9b21f6903b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:18.670663 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c5447348-9974-4c78-9135-3d9b21f6903b tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.265104 Oct 27 09:41:18.671227 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 340/686] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:18 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:19.658140 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1c7e43c2-0408-4b6f-883e-f3168ff39b09 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:19.659344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1c7e43c2-0408-4b6f-883e-f3168ff39b09 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:19.666547 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e43c2-0408-4b6f-883e-f3168ff39b09 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:19.667238 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e43c2-0408-4b6f-883e-f3168ff39b09 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:19.667717 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e43c2-0408-4b6f-883e-f3168ff39b09 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:19.668406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e43c2-0408-4b6f-883e-f3168ff39b09 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:19.668887 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e43c2-0408-4b6f-883e-f3168ff39b09 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:19.669315 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e43c2-0408-4b6f-883e-f3168ff39b09 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:19.694687 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-acdaf858-40d8-4238-80a4-81bbdb08e69d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:19.695517 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-acdaf858-40d8-4238-80a4-81bbdb08e69d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:19.703158 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acdaf858-40d8-4238-80a4-81bbdb08e69d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:19.703731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acdaf858-40d8-4238-80a4-81bbdb08e69d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:19.704192 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acdaf858-40d8-4238-80a4-81bbdb08e69d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:19.705109 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acdaf858-40d8-4238-80a4-81bbdb08e69d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:19.705546 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acdaf858-40d8-4238-80a4-81bbdb08e69d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:19.705972 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-acdaf858-40d8-4238-80a4-81bbdb08e69d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:19.854406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1c7e43c2-0408-4b6f-883e-f3168ff39b09 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:19.862834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1c7e43c2-0408-4b6f-883e-f3168ff39b09 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.208921 Oct 27 09:41:19.863497 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 347/687] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:19 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:19.868635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-607072670", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "54e57d1c-1c3b-4e76-95bb-f2706c028f98"}], "security_groups": [{"name": "tempest-securitygroup--613887471"}], "key_name": "tempest-keypair-43850174", "user_data": "}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:19.896781 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-acdaf858-40d8-4238-80a4-81bbdb08e69d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:19.905807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-acdaf858-40d8-4238-80a4-81bbdb08e69d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.215225 Oct 27 09:41:19.906378 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 341/688] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:19 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:19.969196 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.network.neutron [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] validate_networks() for [('54e57d1c-1c3b-4e76-95bb-f2706c028f98', None, None, None, None, None)] {{(pid=125361) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:41:20.330809 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Flavor limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:41:20.331228 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Image limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:41:20.331699 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Flavor pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:41:20.332130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Image pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:41:20.332554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:41:20.341766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.342242 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.342671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.343388 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.343839 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.344261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.361109 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Getting quotas for project 7295248456c446bbb3f7d2d5953c9360. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:41:20.365047 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Getting quotas for user 2dea51c29cbd46e8bd1454e10eaac012 and project 7295248456c446bbb3f7d2d5953c9360. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:41:20.375786 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Going to run 1 instances... {{(pid=125361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:41:20.378106 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:41:20.424713 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-07a736b5-35a3-48b1-adef-2b5a0409e57a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.560044 Oct 27 09:41:20.425289 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 348/689] 10.222.0.70 () {62 vars in 1188 bytes} [Thu Oct 27 09:41:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 09:41:20.435976 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a2c3cd93-360a-4059-be46-acf38ff14179 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:20.436158 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2097caa7-fe4b-4eeb-8c27-39284c295321 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:20.436616 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2097caa7-fe4b-4eeb-8c27-39284c295321 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:20.436752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a2c3cd93-360a-4059-be46-acf38ff14179 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:20.442861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2097caa7-fe4b-4eeb-8c27-39284c295321 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.443476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2097caa7-fe4b-4eeb-8c27-39284c295321 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.443919 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2097caa7-fe4b-4eeb-8c27-39284c295321 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.444719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2097caa7-fe4b-4eeb-8c27-39284c295321 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.445209 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2097caa7-fe4b-4eeb-8c27-39284c295321 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.445637 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2097caa7-fe4b-4eeb-8c27-39284c295321 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.474162 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2097caa7-fe4b-4eeb-8c27-39284c295321 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf/ips" status: 200 len: 150 microversion: 2.1 time: 0.041791 Oct 27 09:41:20.474919 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 342/690] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Oct 27 09:41:20 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:20.487342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf79691a-1708-4f55-80a1-2b2f378c46eb"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:20.489796 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:20.495880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.496358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.497374 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.497860 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a2c3cd93-360a-4059-be46-acf38ff14179 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:20.498080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.498527 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.498941 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.507523 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a2c3cd93-360a-4059-be46-acf38ff14179 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:20.509127 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a2c3cd93-360a-4059-be46-acf38ff14179 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:20.510367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a2c3cd93-360a-4059-be46-acf38ff14179 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1279 microversion: 2.20 time: 0.078100 Oct 27 09:41:20.511323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 349/691] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:20 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1279 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:41:20.586346 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Invalid volume: volume cf79691a-1708-4f55-80a1-2b2f378c46eb is already attached to instances: 03530ba9-438a-41c2-8e0c-72e90cc316cc Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: POST /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf/os-volume_attachments HTTP/1.1 Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 74 Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:41:20.588544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {"volumeAttachment": {"volumeId": "cf79691a-1708-4f55-80a1-2b2f378c46eb"}} Oct 27 09:41:20.590038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Invalid volume: volume cf79691a-1708-4f55-80a1-2b2f378c46eb is already attached to instances: 03530ba9-438a-41c2-8e0c-72e90cc316cc Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'server_id': '0757d24a-7369-4583-8b26-85d48e0ba6cf', 'body': {'volumeAttachment': {'volumeId': 'cf79691a-1708-4f55-80a1-2b2f378c46eb'}}} Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cf79691a-1708-4f55-80a1-2b2f378c46eb is already attached to instances: 03530ba9-438a-41c2-8e0c-72e90cc316cc Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:20.590893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cf79691a-1708-4f55-80a1-2b2f378c46eb is already attached to instances: 03530ba9-438a-41c2-8e0c-72e90cc316cc Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:20.592206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:20.593806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:20.593806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:41:20.593806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:41:20.593806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cf79691a-1708-4f55-80a1-2b2f378c46eb is already attached to instances: 03530ba9-438a-41c2-8e0c-72e90cc316cc Oct 27 09:41:20.593806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:20.593806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 400 to user: Invalid volume: volume cf79691a-1708-4f55-80a1-2b2f378c46eb is already attached to instances: 03530ba9-438a-41c2-8e0c-72e90cc316cc {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:41:20.593806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-71694a94-8298-4fe6-b157-54e810fa2853 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106604 Oct 27 09:41:20.593806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 343/692] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:41:20 2022] POST /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 27 09:41:20.598630 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-09fa9e4e-935c-4f78-96b8-b27eaf0e01c4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:20.599156 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-09fa9e4e-935c-4f78-96b8-b27eaf0e01c4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:20.605322 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09fa9e4e-935c-4f78-96b8-b27eaf0e01c4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.605804 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09fa9e4e-935c-4f78-96b8-b27eaf0e01c4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.606237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09fa9e4e-935c-4f78-96b8-b27eaf0e01c4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.607198 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09fa9e4e-935c-4f78-96b8-b27eaf0e01c4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.607683 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09fa9e4e-935c-4f78-96b8-b27eaf0e01c4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.608074 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-09fa9e4e-935c-4f78-96b8-b27eaf0e01c4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.632725 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-09fa9e4e-935c-4f78-96b8-b27eaf0e01c4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Going to try to terminate instance {{(pid=125361) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:41:20.709053 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-09fa9e4e-935c-4f78-96b8-b27eaf0e01c4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 204 len: 0 microversion: 2.1 time: 0.114022 Oct 27 09:41:20.709744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 350/693] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:41:20 2022] DELETE /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:41:20.718454 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-476a8baf-ebfa-446a-be2b-d40a427c0c71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:20.719075 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-476a8baf-ebfa-446a-be2b-d40a427c0c71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:20.727620 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-476a8baf-ebfa-446a-be2b-d40a427c0c71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.728405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-476a8baf-ebfa-446a-be2b-d40a427c0c71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.729064 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-476a8baf-ebfa-446a-be2b-d40a427c0c71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.729959 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-476a8baf-ebfa-446a-be2b-d40a427c0c71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.730574 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-476a8baf-ebfa-446a-be2b-d40a427c0c71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.731229 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-476a8baf-ebfa-446a-be2b-d40a427c0c71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.869672 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-476a8baf-ebfa-446a-be2b-d40a427c0c71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:20.877337 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-476a8baf-ebfa-446a-be2b-d40a427c0c71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1683 microversion: 2.1 time: 0.162765 Oct 27 09:41:20.877934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 344/694] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:20 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:20.886513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e1f0e402-7d93-44f9-88ee-01991330987a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:20.887217 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e1f0e402-7d93-44f9-88ee-01991330987a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:20.893120 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e1f0e402-7d93-44f9-88ee-01991330987a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.893602 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e1f0e402-7d93-44f9-88ee-01991330987a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.894034 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e1f0e402-7d93-44f9-88ee-01991330987a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.894719 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e1f0e402-7d93-44f9-88ee-01991330987a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.895174 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e1f0e402-7d93-44f9-88ee-01991330987a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.895597 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e1f0e402-7d93-44f9-88ee-01991330987a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.928015 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8f69bab3-158f-48ab-969a-cb857c484cb6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:20.928665 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8f69bab3-158f-48ab-969a-cb857c484cb6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:20.935186 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8f69bab3-158f-48ab-969a-cb857c484cb6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.935744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8f69bab3-158f-48ab-969a-cb857c484cb6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.936267 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8f69bab3-158f-48ab-969a-cb857c484cb6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:20.937055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8f69bab3-158f-48ab-969a-cb857c484cb6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:20.937577 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8f69bab3-158f-48ab-969a-cb857c484cb6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:20.938032 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8f69bab3-158f-48ab-969a-cb857c484cb6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:21.078638 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e1f0e402-7d93-44f9-88ee-01991330987a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:21.086713 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e1f0e402-7d93-44f9-88ee-01991330987a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.204360 Oct 27 09:41:21.087287 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 351/695] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:20 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:21.113914 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8f69bab3-158f-48ab-969a-cb857c484cb6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:21.122486 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8f69bab3-158f-48ab-969a-cb857c484cb6 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.198422 Oct 27 09:41:21.123040 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 345/696] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:20 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:21.535697 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:21.536230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:21.542627 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:21.543122 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:21.543540 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:21.544254 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:21.544731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:21.545180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:21.610793 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:21.618878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:21.621063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:21.622176 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c3f335c1-7ba8-433e-b3fb-a288cf940c42 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1283 microversion: 2.20 time: 0.090458 Oct 27 09:41:21.622740 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 352/697] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:21 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1283 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:21.900998 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f87e7b42-af87-4ecc-9d13-ef341d9d582d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:21.901639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f87e7b42-af87-4ecc-9d13-ef341d9d582d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:21.908070 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f87e7b42-af87-4ecc-9d13-ef341d9d582d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:21.908565 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f87e7b42-af87-4ecc-9d13-ef341d9d582d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:21.908994 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f87e7b42-af87-4ecc-9d13-ef341d9d582d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:21.909671 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f87e7b42-af87-4ecc-9d13-ef341d9d582d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:21.910117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f87e7b42-af87-4ecc-9d13-ef341d9d582d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:21.910533 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f87e7b42-af87-4ecc-9d13-ef341d9d582d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:22.040494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f87e7b42-af87-4ecc-9d13-ef341d9d582d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:22.050109 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f87e7b42-af87-4ecc-9d13-ef341d9d582d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1683 microversion: 2.1 time: 0.152364 Oct 27 09:41:22.050109 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 346/698] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:21 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:22.110371 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-56625c59-3133-484e-9e39-87f12c6c2605 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:22.110980 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-56625c59-3133-484e-9e39-87f12c6c2605 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:22.117419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-56625c59-3133-484e-9e39-87f12c6c2605 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:22.117902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-56625c59-3133-484e-9e39-87f12c6c2605 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:22.118339 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-56625c59-3133-484e-9e39-87f12c6c2605 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:22.119025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-56625c59-3133-484e-9e39-87f12c6c2605 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:22.119485 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-56625c59-3133-484e-9e39-87f12c6c2605 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:22.119908 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-56625c59-3133-484e-9e39-87f12c6c2605 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:22.146430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3470c1dc-0f64-48e6-8a5e-fac575617fb2 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:22.147175 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-3470c1dc-0f64-48e6-8a5e-fac575617fb2 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:22.156991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3470c1dc-0f64-48e6-8a5e-fac575617fb2 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:22.157578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3470c1dc-0f64-48e6-8a5e-fac575617fb2 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:22.158095 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3470c1dc-0f64-48e6-8a5e-fac575617fb2 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:22.158864 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3470c1dc-0f64-48e6-8a5e-fac575617fb2 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:22.159321 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3470c1dc-0f64-48e6-8a5e-fac575617fb2 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:22.159742 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3470c1dc-0f64-48e6-8a5e-fac575617fb2 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:22.304651 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-56625c59-3133-484e-9e39-87f12c6c2605 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:22.315393 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-56625c59-3133-484e-9e39-87f12c6c2605 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.208756 Oct 27 09:41:22.316224 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 353/699] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:22 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:22.345831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-3470c1dc-0f64-48e6-8a5e-fac575617fb2 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:22.355233 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3470c1dc-0f64-48e6-8a5e-fac575617fb2 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.212719 Oct 27 09:41:22.355805 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 347/700] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:22 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:22.648649 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:22.649525 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:22.655655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:22.656142 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:22.656598 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:22.657294 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:22.657743 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:22.658164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:22.727920 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:22.736052 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:22.737527 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:22.738635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6e685630-fcb6-441d-9219-f9f03985f3f0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1331 microversion: 2.20 time: 0.095406 Oct 27 09:41:22.739191 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 354/701] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:22 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:23.073661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-129091c6-91a8-4c00-bfe9-4cbf4eb01004 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:23.074871 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-129091c6-91a8-4c00-bfe9-4cbf4eb01004 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:23.083682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-129091c6-91a8-4c00-bfe9-4cbf4eb01004 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:23.084380 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-129091c6-91a8-4c00-bfe9-4cbf4eb01004 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:23.085032 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-129091c6-91a8-4c00-bfe9-4cbf4eb01004 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:23.085923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-129091c6-91a8-4c00-bfe9-4cbf4eb01004 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:23.086554 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-129091c6-91a8-4c00-bfe9-4cbf4eb01004 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:23.087173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-129091c6-91a8-4c00-bfe9-4cbf4eb01004 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:23.170566 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-129091c6-91a8-4c00-bfe9-4cbf4eb01004 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:23.178924 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-129091c6-91a8-4c00-bfe9-4cbf4eb01004 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1615 microversion: 2.1 time: 0.109110 Oct 27 09:41:23.179995 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 348/702] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:23 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1615 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:23.339929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ae9539de-4504-4422-9e0c-70380e816aa2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:23.341207 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ae9539de-4504-4422-9e0c-70380e816aa2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:23.352132 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ae9539de-4504-4422-9e0c-70380e816aa2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:23.353721 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ae9539de-4504-4422-9e0c-70380e816aa2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:23.354929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ae9539de-4504-4422-9e0c-70380e816aa2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:23.361585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ae9539de-4504-4422-9e0c-70380e816aa2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:23.362413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ae9539de-4504-4422-9e0c-70380e816aa2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:23.363158 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ae9539de-4504-4422-9e0c-70380e816aa2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:23.369304 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-64aab97f-d412-4b4d-a02b-521efe7e0b48 req-90ce5efc-2723-49ea-8aed-1a1469732f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0757d24a-7369-4583-8b26-85d48e0ba6cf", "name": "network-vif-deleted", "tag": "679f3124-ba7d-4f06-8f2b-63d51480c3ff"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:23.388022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-64aab97f-d412-4b4d-a02b-521efe7e0b48 req-90ce5efc-2723-49ea-8aed-1a1469732f79 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:23.389778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-64aab97f-d412-4b4d-a02b-521efe7e0b48 req-90ce5efc-2723-49ea-8aed-1a1469732f79 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:23.390821 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-64aab97f-d412-4b4d-a02b-521efe7e0b48 req-90ce5efc-2723-49ea-8aed-1a1469732f79 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:23.409108 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-64aab97f-d412-4b4d-a02b-521efe7e0b48 req-90ce5efc-2723-49ea-8aed-1a1469732f79 service nova] Creating event network-vif-deleted:679f3124-ba7d-4f06-8f2b-63d51480c3ff for instance 0757d24a-7369-4583-8b26-85d48e0ba6cf on hv-cinder-79797 Oct 27 09:41:23.417607 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-64aab97f-d412-4b4d-a02b-521efe7e0b48 req-90ce5efc-2723-49ea-8aed-1a1469732f79 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060210 Oct 27 09:41:23.418959 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 349/703] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:23.441957 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-73432c5d-f267-451c-bd25-148ff906b24d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:23.444457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-73432c5d-f267-451c-bd25-148ff906b24d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:23.459702 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73432c5d-f267-451c-bd25-148ff906b24d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:23.463434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73432c5d-f267-451c-bd25-148ff906b24d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:23.464156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73432c5d-f267-451c-bd25-148ff906b24d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:23.465126 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73432c5d-f267-451c-bd25-148ff906b24d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:23.465606 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73432c5d-f267-451c-bd25-148ff906b24d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:23.466039 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-73432c5d-f267-451c-bd25-148ff906b24d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:23.744107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ae9539de-4504-4422-9e0c-70380e816aa2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:23.756355 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-73432c5d-f267-451c-bd25-148ff906b24d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:23.768745 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ae9539de-4504-4422-9e0c-70380e816aa2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.428693 Oct 27 09:41:23.770735 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 355/704] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:23 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:23.773962 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-73432c5d-f267-451c-bd25-148ff906b24d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.353308 Oct 27 09:41:23.775949 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 350/705] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:23 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:23.799746 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:23.800763 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:23.808020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:23.808536 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:23.809016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:23.810092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:23.810604 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:23.811164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:23.891486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:23.902393 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:23.904873 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:23.906077 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b2eac548-1f9d-4109-add9-7b060cbd3b22 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1337 microversion: 2.20 time: 0.133250 Oct 27 09:41:23.906829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 356/706] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:23 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1337 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:24.203980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:24.204640 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:24.221235 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:24.222067 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:24.222908 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:24.224260 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:24.225428 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:24.226328 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:24.282028 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:24.282775 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:24.283375 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:24.284000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lazy-loading 'fault' on Instance uuid 0757d24a-7369-4583-8b26-85d48e0ba6cf {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:41:24.290555 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:24.341542 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:24.350031 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fb757d79-51a0-4347-85de-9eedc3ace58c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 200 len: 1332 microversion: 2.1 time: 0.150102 Oct 27 09:41:24.356263 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 351/707] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:24 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 1332 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:24.793348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b9eca70e-1102-43de-8116-11528035c0a2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:24.794020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b9eca70e-1102-43de-8116-11528035c0a2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:24.800499 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9eca70e-1102-43de-8116-11528035c0a2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:24.801195 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9eca70e-1102-43de-8116-11528035c0a2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:24.801818 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9eca70e-1102-43de-8116-11528035c0a2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:24.802512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9eca70e-1102-43de-8116-11528035c0a2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:24.802962 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9eca70e-1102-43de-8116-11528035c0a2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:24.803441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b9eca70e-1102-43de-8116-11528035c0a2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:24.807610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2b154279-a4d9-4167-870e-44dcd0e8a259 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:24.808173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2b154279-a4d9-4167-870e-44dcd0e8a259 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:24.814187 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b154279-a4d9-4167-870e-44dcd0e8a259 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:24.814744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b154279-a4d9-4167-870e-44dcd0e8a259 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:24.815185 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b154279-a4d9-4167-870e-44dcd0e8a259 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:24.816217 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b154279-a4d9-4167-870e-44dcd0e8a259 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:24.816868 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b154279-a4d9-4167-870e-44dcd0e8a259 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:24.817457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2b154279-a4d9-4167-870e-44dcd0e8a259 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:25.307438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b9eca70e-1102-43de-8116-11528035c0a2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:25.317398 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b9eca70e-1102-43de-8116-11528035c0a2 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.527788 Oct 27 09:41:25.318167 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 357/708] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:24 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:25.318503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2b154279-a4d9-4167-870e-44dcd0e8a259 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:25.324845 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:25.325463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:25.328638 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2b154279-a4d9-4167-870e-44dcd0e8a259 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1757 microversion: 2.1 time: 0.525729 Oct 27 09:41:25.329677 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 352/709] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:24 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1757 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:25.339277 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:25.339838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:25.340377 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:25.341428 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:25.341923 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:25.342348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:25.349519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:25.374603 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:25.375231 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:25.382568 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:25.382696 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:25.383138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:25.383844 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:25.384372 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:25.384965 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:25.398712 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf HTTP/1.1 Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:41:25.400401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:41:25.401880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '0757d24a-7369-4583-8b26-85d48e0ba6cf'} Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:41:25.402572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:41:25.403753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:25.404849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:41:25.404849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5897c375-3fae-443d-bf07-3a142f5b7f07 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 404 len: 111 microversion: 2.1 time: 0.031487 Oct 27 09:41:25.404849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 353/710] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:25 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:41:25.410524 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-99984254-e2cf-4c11-a63e-dce973a9c197 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '.version_select at 0x7f36492a6670>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:25.433614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-99984254-e2cf-4c11-a63e-dce973a9c197 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047436337" status: 202 len: 0 microversion: 2.1 time: 0.026253 Oct 27 09:41:25.434584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 354/711] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Oct 27 09:41:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047436337 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:41:25.491592 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:25.501538 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:25.503244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:25.504271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-64b34088-495b-46b7-9a97-335a35cde408 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1404 microversion: 2.20 time: 0.185002 Oct 27 09:41:25.517637 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 358/712] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:25 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:25.523972 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-8ca0947b-e1c8-4f65-a3e6-d381b314d978 req-009deb7e-98f3-4660-8842-8b71ddb9550b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a898b1b-5c82-41b1-8b68-0ad30a3516a1", "tag": "c4193921-efc0-4d0e-8a62-50ecf8de25b1"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:25.541807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-8ca0947b-e1c8-4f65-a3e6-d381b314d978 req-009deb7e-98f3-4660-8842-8b71ddb9550b service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:25.542348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-8ca0947b-e1c8-4f65-a3e6-d381b314d978 req-009deb7e-98f3-4660-8842-8b71ddb9550b service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:25.543079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-8ca0947b-e1c8-4f65-a3e6-d381b314d978 req-009deb7e-98f3-4660-8842-8b71ddb9550b service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:25.559821 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-8ca0947b-e1c8-4f65-a3e6-d381b314d978 req-009deb7e-98f3-4660-8842-8b71ddb9550b service nova] Creating event network-changed:c4193921-efc0-4d0e-8a62-50ecf8de25b1 for instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 on hv-cinder-79797 Oct 27 09:41:25.565064 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-8ca0947b-e1c8-4f65-a3e6-d381b314d978 req-009deb7e-98f3-4660-8842-8b71ddb9550b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045191 Oct 27 09:41:25.565843 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 355/713] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:26.248031 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-63e85a98-da0c-4495-8784-6c3d0fcf2b18 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:26.248583 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-63e85a98-da0c-4495-8784-6c3d0fcf2b18 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:26.254763 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63e85a98-da0c-4495-8784-6c3d0fcf2b18 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:26.255245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63e85a98-da0c-4495-8784-6c3d0fcf2b18 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:26.255674 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63e85a98-da0c-4495-8784-6c3d0fcf2b18 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:26.256389 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63e85a98-da0c-4495-8784-6c3d0fcf2b18 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:26.256860 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63e85a98-da0c-4495-8784-6c3d0fcf2b18 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:26.257312 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63e85a98-da0c-4495-8784-6c3d0fcf2b18 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:26.340662 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-63e85a98-da0c-4495-8784-6c3d0fcf2b18 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lazy-loading 'services' on Instance uuid 03530ba9-438a-41c2-8e0c-72e90cc316cc {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:41:26.341290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-75ca29d6-7d79-47c3-9bcf-1ef97a1f8157 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:26.341995 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-75ca29d6-7d79-47c3-9bcf-1ef97a1f8157 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:26.348759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75ca29d6-7d79-47c3-9bcf-1ef97a1f8157 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:26.349094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75ca29d6-7d79-47c3-9bcf-1ef97a1f8157 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:26.349534 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75ca29d6-7d79-47c3-9bcf-1ef97a1f8157 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:26.350235 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75ca29d6-7d79-47c3-9bcf-1ef97a1f8157 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:26.350696 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75ca29d6-7d79-47c3-9bcf-1ef97a1f8157 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:26.351128 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75ca29d6-7d79-47c3-9bcf-1ef97a1f8157 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:26.412701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-63e85a98-da0c-4495-8784-6c3d0fcf2b18 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments/cf79691a-1708-4f55-80a1-2b2f378c46eb" status: 202 len: 0 microversion: 2.1 time: 0.168837 Oct 27 09:41:26.413409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 359/714] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:41:26 2022] DELETE /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments/cf79691a-1708-4f55-80a1-2b2f378c46eb => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:41:26.418629 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-75baa097-5fd8-4913-beb3-d60fe78e6fdc tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:26.419405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-75baa097-5fd8-4913-beb3-d60fe78e6fdc tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:26.425857 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75baa097-5fd8-4913-beb3-d60fe78e6fdc tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:26.426367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75baa097-5fd8-4913-beb3-d60fe78e6fdc tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:26.426804 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75baa097-5fd8-4913-beb3-d60fe78e6fdc tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:26.427517 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75baa097-5fd8-4913-beb3-d60fe78e6fdc tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:26.427990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75baa097-5fd8-4913-beb3-d60fe78e6fdc tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:26.428407 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75baa097-5fd8-4913-beb3-d60fe78e6fdc tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:26.554610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-75ca29d6-7d79-47c3-9bcf-1ef97a1f8157 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:26.563856 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-75ca29d6-7d79-47c3-9bcf-1ef97a1f8157 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.226705 Oct 27 09:41:26.564628 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 356/715] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:26 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:26.569396 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c51c0164-45d7-4972-8ccd-697b508f2480 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:26.572644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c51c0164-45d7-4972-8ccd-697b508f2480 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:26.578934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c51c0164-45d7-4972-8ccd-697b508f2480 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:26.579421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c51c0164-45d7-4972-8ccd-697b508f2480 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:26.579859 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c51c0164-45d7-4972-8ccd-697b508f2480 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:26.580589 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c51c0164-45d7-4972-8ccd-697b508f2480 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:26.581172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c51c0164-45d7-4972-8ccd-697b508f2480 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:26.581604 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c51c0164-45d7-4972-8ccd-697b508f2480 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:26.613977 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c51c0164-45d7-4972-8ccd-697b508f2480 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Oct 27 09:41:26.614548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 357/716] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:41:26 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:26.619720 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:26.620323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:26.623356 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:26.627330 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:26.627814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:26.628249 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:26.628971 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:26.629430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:26.629854 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:26.687291 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-75baa097-5fd8-4913-beb3-d60fe78e6fdc tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:26.695393 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-75baa097-5fd8-4913-beb3-d60fe78e6fdc tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1760 microversion: 2.1 time: 0.280817 Oct 27 09:41:26.695964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 360/717] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:26 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1760 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:26.771037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:26.779053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:26.780488 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:26.781611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b672d941-ea43-4e5e-9b4a-e2089359816e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1404 microversion: 2.20 time: 0.165982 Oct 27 09:41:26.782167 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 358/718] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:26 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:27.590874 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1c7e6629-6ff0-4817-86af-43c6541b5b6d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:27.591526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1c7e6629-6ff0-4817-86af-43c6541b5b6d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:27.595029 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:27.598983 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e6629-6ff0-4817-86af-43c6541b5b6d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:27.599488 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e6629-6ff0-4817-86af-43c6541b5b6d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:27.599909 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e6629-6ff0-4817-86af-43c6541b5b6d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:27.600629 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e6629-6ff0-4817-86af-43c6541b5b6d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:27.601085 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e6629-6ff0-4817-86af-43c6541b5b6d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:27.601510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1c7e6629-6ff0-4817-86af-43c6541b5b6d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:27.627365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-baebf816-48fe-400b-9e50-8b2b98fac95b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:27.629845 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-baebf816-48fe-400b-9e50-8b2b98fac95b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:27.637015 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-baebf816-48fe-400b-9e50-8b2b98fac95b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:27.637629 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-baebf816-48fe-400b-9e50-8b2b98fac95b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:27.638071 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-baebf816-48fe-400b-9e50-8b2b98fac95b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:27.638862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-baebf816-48fe-400b-9e50-8b2b98fac95b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:27.639325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-baebf816-48fe-400b-9e50-8b2b98fac95b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:27.640059 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-baebf816-48fe-400b-9e50-8b2b98fac95b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:27.671282 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-baebf816-48fe-400b-9e50-8b2b98fac95b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047791 Oct 27 09:41:27.672116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 359/719] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:41:27 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:27.807112 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:27.807842 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:27.813832 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:27.814395 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:27.814907 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:27.815693 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:27.816223 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:27.816760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:27.932050 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1c7e6629-6ff0-4817-86af-43c6541b5b6d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:27.940947 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1c7e6629-6ff0-4817-86af-43c6541b5b6d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1737 microversion: 2.1 time: 0.354509 Oct 27 09:41:27.941522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 361/720] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:27 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1737 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:27.975986 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:27.984644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:27.986088 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:27.987223 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-460e5c5d-afd7-4ce5-82b3-726406e043e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1404 microversion: 2.20 time: 0.184494 Oct 27 09:41:27.987783 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 360/721] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:27 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1404 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:28.683828 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c5b51097-b5db-46a6-acb1-5ac71c785b20 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:28.686137 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c5b51097-b5db-46a6-acb1-5ac71c785b20 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:28.692790 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5b51097-b5db-46a6-acb1-5ac71c785b20 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:28.693338 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5b51097-b5db-46a6-acb1-5ac71c785b20 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:28.693729 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5b51097-b5db-46a6-acb1-5ac71c785b20 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:28.694411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5b51097-b5db-46a6-acb1-5ac71c785b20 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:28.694859 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5b51097-b5db-46a6-acb1-5ac71c785b20 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:28.695274 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5b51097-b5db-46a6-acb1-5ac71c785b20 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:28.715947 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a7fa98cb-83db-44a4-8577-3ed8d4501bad tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:28.718144 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a7fa98cb-83db-44a4-8577-3ed8d4501bad tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:28.720002 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=4 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:28.725130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c5b51097-b5db-46a6-acb1-5ac71c785b20 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Oct 27 09:41:28.725688 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 362/722] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:41:28 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:28.725907 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a7fa98cb-83db-44a4-8577-3ed8d4501bad tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:28.726463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a7fa98cb-83db-44a4-8577-3ed8d4501bad tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:28.726911 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a7fa98cb-83db-44a4-8577-3ed8d4501bad tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:28.727613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a7fa98cb-83db-44a4-8577-3ed8d4501bad tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:28.728918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a7fa98cb-83db-44a4-8577-3ed8d4501bad tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:28.729349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a7fa98cb-83db-44a4-8577-3ed8d4501bad tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:28.758457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a7fa98cb-83db-44a4-8577-3ed8d4501bad tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047718 Oct 27 09:41:28.759063 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 361/723] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:41:28 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:41:28.824021 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6c454946-8c1f-4f8c-9026-210655017248 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:28.824532 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6c454946-8c1f-4f8c-9026-210655017248 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:28.830655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c454946-8c1f-4f8c-9026-210655017248 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:28.831134 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c454946-8c1f-4f8c-9026-210655017248 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:28.831564 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c454946-8c1f-4f8c-9026-210655017248 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:28.832238 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c454946-8c1f-4f8c-9026-210655017248 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:28.832714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c454946-8c1f-4f8c-9026-210655017248 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:28.833130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6c454946-8c1f-4f8c-9026-210655017248 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:28.866464 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6c454946-8c1f-4f8c-9026-210655017248 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Going to try to terminate instance {{(pid=125361) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:41:28.948112 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6c454946-8c1f-4f8c-9026-210655017248 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 204 len: 0 microversion: 2.1 time: 0.127906 Oct 27 09:41:28.948840 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 363/724] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:41:28 2022] DELETE /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:41:28.957920 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5e3bef50-a5e4-420d-992c-fbea35dd9c7b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:28.958623 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5e3bef50-a5e4-420d-992c-fbea35dd9c7b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:28.965981 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5986fa96-89c5-4336-8286-0b5bba11933a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:28.966850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5986fa96-89c5-4336-8286-0b5bba11933a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:28.968595 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5e3bef50-a5e4-420d-992c-fbea35dd9c7b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:28.969102 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5e3bef50-a5e4-420d-992c-fbea35dd9c7b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:28.969548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5e3bef50-a5e4-420d-992c-fbea35dd9c7b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:28.970257 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5e3bef50-a5e4-420d-992c-fbea35dd9c7b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:28.970715 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5e3bef50-a5e4-420d-992c-fbea35dd9c7b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:28.971142 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5e3bef50-a5e4-420d-992c-fbea35dd9c7b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:28.972770 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5986fa96-89c5-4336-8286-0b5bba11933a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:28.973259 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5986fa96-89c5-4336-8286-0b5bba11933a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:28.973721 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5986fa96-89c5-4336-8286-0b5bba11933a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:28.974406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5986fa96-89c5-4336-8286-0b5bba11933a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:28.974855 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5986fa96-89c5-4336-8286-0b5bba11933a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:28.975275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5986fa96-89c5-4336-8286-0b5bba11933a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.167851 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5e3bef50-a5e4-420d-992c-fbea35dd9c7b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:29.171902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5986fa96-89c5-4336-8286-0b5bba11933a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:29.175795 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5e3bef50-a5e4-420d-992c-fbea35dd9c7b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1672 microversion: 2.1 time: 0.221895 Oct 27 09:41:29.176363 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 362/725] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:28 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:29.180214 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5986fa96-89c5-4336-8286-0b5bba11933a tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1717 microversion: 2.1 time: 0.219538 Oct 27 09:41:29.180935 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 364/726] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:28 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1717 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:29.190469 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:29.191080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:29.197534 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.198017 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.198513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.199146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.199602 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.200029 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.302026 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:29.302520 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:29.309116 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.309695 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.310134 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.310912 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.311434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.311867 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.333199 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:29.341375 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:29.342815 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:29.343916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ef10a8ef-7ca8-4cb7-a5ec-4e1e1d1cbf96 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1404 microversion: 2.20 time: 0.157312 Oct 27 09:41:29.344467 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 363/727] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:29 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:29.394253 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] HTTP exception thrown: Cannot 'detach_volume' instance d2612979-fbed-42ac-b725-265018416862 while it is in vm_state rescued Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Request method failure captured: Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: DELETE /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments/8c94c5a3-ef45-4079-98ad-2a7e7630cdf4 HTTP/1.1 Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEs5-tbzfNHaXrPO8RXRj9dewnCV2HOUd33_QWfCuKyBAx1Ix27FgqyKSHqu3c5HxuyE46MIa6u9OKbQgr2_gH2DdthtJSgHCsIx2TZb8X_KnoKljFtMa40Qmv-Uellj9bNNfFAaBQ2vKscoeJD-eIA3KY14nB7Y7QCgN9f6RkwKtc Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: df306d37ff634f7eaad80fc3bc65b653 Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:41:29.395831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: df306d37ff634f7eaad80fc3bc65b653 Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-ServerRescueNegativeTestJSON-1374072368-project Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 20c65ed67cd8403489949c4dea572d01 Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1374072368-project Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:41:29.397413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Cannot 'detach_volume' instance d2612979-fbed-42ac-b725-265018416862 while it is in vm_state rescued Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'server_id': 'd2612979-fbed-42ac-b725-265018416862', 'id': '8c94c5a3-ef45-4079-98ad-2a7e7630cdf4'} Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d2612979-fbed-42ac-b725-265018416862 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:41:29.398272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d2612979-fbed-42ac-b725-265018416862 while it is in vm_state rescued Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d2612979-fbed-42ac-b725-265018416862 while it is in vm_state rescued Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:41:29.399787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Returning 409 to user: Cannot 'detach_volume' instance d2612979-fbed-42ac-b725-265018416862 while it is in vm_state rescued {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:41:29.401040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4f890f25-e1ff-429d-8e16-0e73b6f11838 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments/8c94c5a3-ef45-4079-98ad-2a7e7630cdf4" status: 409 len: 152 microversion: 2.1 time: 0.099262 Oct 27 09:41:29.401040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 365/728] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:41:29 2022] DELETE /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments/8c94c5a3-ef45-4079-98ad-2a7e7630cdf4 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 09:41:29.405991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c86479f3-8f73-4af7-9010-50067d5e7a73 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:29.406526 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c86479f3-8f73-4af7-9010-50067d5e7a73 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:29.412358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c86479f3-8f73-4af7-9010-50067d5e7a73 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.412882 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c86479f3-8f73-4af7-9010-50067d5e7a73 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.413311 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c86479f3-8f73-4af7-9010-50067d5e7a73 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.414000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c86479f3-8f73-4af7-9010-50067d5e7a73 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.414449 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c86479f3-8f73-4af7-9010-50067d5e7a73 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.414869 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c86479f3-8f73-4af7-9010-50067d5e7a73 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.481207 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c86479f3-8f73-4af7-9010-50067d5e7a73 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "POST /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/action" status: 202 len: 0 microversion: 2.1 time: 0.078676 Oct 27 09:41:29.484688 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 364/729] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:41:29 2022] POST /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:41:29.489814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2156751e-0f3e-422f-a32d-a70d90188bb1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:29.490419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2156751e-0f3e-422f-a32d-a70d90188bb1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:29.497705 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2156751e-0f3e-422f-a32d-a70d90188bb1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.498165 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2156751e-0f3e-422f-a32d-a70d90188bb1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.498596 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2156751e-0f3e-422f-a32d-a70d90188bb1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.499271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2156751e-0f3e-422f-a32d-a70d90188bb1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.499718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2156751e-0f3e-422f-a32d-a70d90188bb1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.500132 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2156751e-0f3e-422f-a32d-a70d90188bb1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.629609 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2156751e-0f3e-422f-a32d-a70d90188bb1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:29.637704 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2156751e-0f3e-422f-a32d-a70d90188bb1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1725 microversion: 2.1 time: 0.151750 Oct 27 09:41:29.638257 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 366/730] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:29 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:29.739265 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-35481cba-14dd-429f-93cd-e524506d344c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:29.741560 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-35481cba-14dd-429f-93cd-e524506d344c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:29.748321 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35481cba-14dd-429f-93cd-e524506d344c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.748844 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35481cba-14dd-429f-93cd-e524506d344c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.749284 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35481cba-14dd-429f-93cd-e524506d344c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.749975 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35481cba-14dd-429f-93cd-e524506d344c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:29.750430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35481cba-14dd-429f-93cd-e524506d344c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:29.750855 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-35481cba-14dd-429f-93cd-e524506d344c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:29.779790 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-35481cba-14dd-429f-93cd-e524506d344c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045432 Oct 27 09:41:29.780332 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 365/731] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:41:29 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:30.199264 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8477a85a-278c-4e3b-b78c-75cb66d44161 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:30.199858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8477a85a-278c-4e3b-b78c-75cb66d44161 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:30.207179 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8477a85a-278c-4e3b-b78c-75cb66d44161 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.207664 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8477a85a-278c-4e3b-b78c-75cb66d44161 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.208102 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8477a85a-278c-4e3b-b78c-75cb66d44161 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.208819 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8477a85a-278c-4e3b-b78c-75cb66d44161 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.209273 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8477a85a-278c-4e3b-b78c-75cb66d44161 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.209724 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8477a85a-278c-4e3b-b78c-75cb66d44161 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.339128 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-8477a85a-278c-4e3b-b78c-75cb66d44161 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:30.346873 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8477a85a-278c-4e3b-b78c-75cb66d44161 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1672 microversion: 2.1 time: 0.151631 Oct 27 09:41:30.347441 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 367/732] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:30 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:30.368159 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:30.368806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:30.374681 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.375157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.375587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.376258 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.376732 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.377147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.554230 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:30.564774 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:30.566231 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:30.567903 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-27e1066b-1ded-45d5-8c5e-d7adb148437d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1404 microversion: 2.20 time: 0.203010 Oct 27 09:41:30.568304 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 366/733] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:30 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1404 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:30.660411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-001d4749-c778-4221-879c-c05b43011250 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:30.662361 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-001d4749-c778-4221-879c-c05b43011250 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:30.665035 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:30.666209 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=8 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:30.672359 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-001d4749-c778-4221-879c-c05b43011250 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.673358 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-001d4749-c778-4221-879c-c05b43011250 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.673502 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-001d4749-c778-4221-879c-c05b43011250 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.674730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-001d4749-c778-4221-879c-c05b43011250 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.674859 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-001d4749-c778-4221-879c-c05b43011250 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.675220 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-001d4749-c778-4221-879c-c05b43011250 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.792246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c11a72e3-419b-49aa-825d-34b4143e0f9f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:30.794878 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c11a72e3-419b-49aa-825d-34b4143e0f9f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:30.802021 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c11a72e3-419b-49aa-825d-34b4143e0f9f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.802710 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c11a72e3-419b-49aa-825d-34b4143e0f9f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.803387 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c11a72e3-419b-49aa-825d-34b4143e0f9f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.804204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c11a72e3-419b-49aa-825d-34b4143e0f9f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.805066 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c11a72e3-419b-49aa-825d-34b4143e0f9f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.805733 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c11a72e3-419b-49aa-825d-34b4143e0f9f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.847584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c11a72e3-419b-49aa-825d-34b4143e0f9f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059206 Oct 27 09:41:30.848206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 367/734] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:41:30 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:41:30.909204 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-001d4749-c778-4221-879c-c05b43011250 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:30.916092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-001d4749-c778-4221-879c-c05b43011250 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1725 microversion: 2.1 time: 0.259589 Oct 27 09:41:30.916775 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 368/735] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:30 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:30.920765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fe365b3a-a74a-4950-8a4f-1fe9c19d14ed tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:30.921267 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fe365b3a-a74a-4950-8a4f-1fe9c19d14ed tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:30.927275 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe365b3a-a74a-4950-8a4f-1fe9c19d14ed tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.927776 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe365b3a-a74a-4950-8a4f-1fe9c19d14ed tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.928214 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe365b3a-a74a-4950-8a4f-1fe9c19d14ed tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.928943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe365b3a-a74a-4950-8a4f-1fe9c19d14ed tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:30.929400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe365b3a-a74a-4950-8a4f-1fe9c19d14ed tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:30.929822 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe365b3a-a74a-4950-8a4f-1fe9c19d14ed tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:30.955774 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fe365b3a-a74a-4950-8a4f-1fe9c19d14ed tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:41:30.981601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:31.030339 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fe365b3a-a74a-4950-8a4f-1fe9c19d14ed tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 204 len: 0 microversion: 2.1 time: 0.113255 Oct 27 09:41:31.031153 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 368/736] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:41:30 2022] DELETE /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:41:31.039293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-67a1c49a-2772-4ee0-8569-079753c967dd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:31.040034 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-67a1c49a-2772-4ee0-8569-079753c967dd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:31.046542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67a1c49a-2772-4ee0-8569-079753c967dd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:31.047047 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67a1c49a-2772-4ee0-8569-079753c967dd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:31.047496 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67a1c49a-2772-4ee0-8569-079753c967dd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:31.048243 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67a1c49a-2772-4ee0-8569-079753c967dd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:31.048671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67a1c49a-2772-4ee0-8569-079753c967dd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:31.049095 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67a1c49a-2772-4ee0-8569-079753c967dd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:31.254639 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-67a1c49a-2772-4ee0-8569-079753c967dd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:31.262417 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-67a1c49a-2772-4ee0-8569-079753c967dd tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1680 microversion: 2.1 time: 0.227186 Oct 27 09:41:31.263070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 369/737] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:31 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:31.371449 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-93bc6d03-2bc6-42f2-a3c4-6c1548db762a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:31.372177 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-93bc6d03-2bc6-42f2-a3c4-6c1548db762a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:31.377908 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93bc6d03-2bc6-42f2-a3c4-6c1548db762a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:31.378392 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93bc6d03-2bc6-42f2-a3c4-6c1548db762a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:31.378854 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93bc6d03-2bc6-42f2-a3c4-6c1548db762a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:31.379547 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93bc6d03-2bc6-42f2-a3c4-6c1548db762a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:31.379994 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93bc6d03-2bc6-42f2-a3c4-6c1548db762a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:31.380413 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-93bc6d03-2bc6-42f2-a3c4-6c1548db762a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:31.514866 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-93bc6d03-2bc6-42f2-a3c4-6c1548db762a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:31.522520 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-93bc6d03-2bc6-42f2-a3c4-6c1548db762a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1672 microversion: 2.1 time: 0.155977 Oct 27 09:41:31.523076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 369/738] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:31 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:31.595150 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:31.595758 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:31.601721 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:31.602203 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:31.602641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:31.603896 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:31.604408 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:31.604880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:31.730379 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:31.738609 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:31.740172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:31.741309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-bd17f3c0-5ea5-4cb9-941d-d391e66fd95d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1404 microversion: 2.20 time: 0.150060 Oct 27 09:41:31.741875 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 370/739] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:31 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:31.939537 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-498d9618-089e-4513-a345-a0432a1e219f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:31.940149 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-498d9618-089e-4513-a345-a0432a1e219f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:31.947037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-498d9618-089e-4513-a345-a0432a1e219f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:31.947522 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-498d9618-089e-4513-a345-a0432a1e219f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:31.947958 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-498d9618-089e-4513-a345-a0432a1e219f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:31.948670 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-498d9618-089e-4513-a345-a0432a1e219f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:31.949127 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-498d9618-089e-4513-a345-a0432a1e219f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:31.949548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-498d9618-089e-4513-a345-a0432a1e219f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:32.079620 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-498d9618-089e-4513-a345-a0432a1e219f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:32.088394 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-498d9618-089e-4513-a345-a0432a1e219f tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1725 microversion: 2.1 time: 0.152733 Oct 27 09:41:32.089004 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 370/740] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:31 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:32.285213 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-63230f07-22de-4090-acfa-e5265a71732c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:32.285839 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-63230f07-22de-4090-acfa-e5265a71732c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:32.292260 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63230f07-22de-4090-acfa-e5265a71732c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:32.292766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63230f07-22de-4090-acfa-e5265a71732c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:32.293226 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63230f07-22de-4090-acfa-e5265a71732c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:32.293907 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63230f07-22de-4090-acfa-e5265a71732c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:32.294355 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63230f07-22de-4090-acfa-e5265a71732c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:32.294776 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63230f07-22de-4090-acfa-e5265a71732c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:32.537331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-63230f07-22de-4090-acfa-e5265a71732c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:32.546603 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-63230f07-22de-4090-acfa-e5265a71732c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1680 microversion: 2.1 time: 0.265161 Oct 27 09:41:32.547500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 371/741] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:32 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1680 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:32.555144 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fcd83fac-d2ae-47d2-b4fe-03c373df17f4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:32.555687 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fcd83fac-d2ae-47d2-b4fe-03c373df17f4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:32.563018 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcd83fac-d2ae-47d2-b4fe-03c373df17f4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:32.563510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcd83fac-d2ae-47d2-b4fe-03c373df17f4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:32.563946 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcd83fac-d2ae-47d2-b4fe-03c373df17f4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:32.564675 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcd83fac-d2ae-47d2-b4fe-03c373df17f4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:32.565133 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcd83fac-d2ae-47d2-b4fe-03c373df17f4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:32.565558 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fcd83fac-d2ae-47d2-b4fe-03c373df17f4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:32.771369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:32.773331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:32.799402 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:32.800358 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:32.801065 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:32.801993 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:32.802692 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:32.803718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:32.836302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:32.881088 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fcd83fac-d2ae-47d2-b4fe-03c373df17f4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:32.891762 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fcd83fac-d2ae-47d2-b4fe-03c373df17f4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1672 microversion: 2.1 time: 0.348567 Oct 27 09:41:32.905887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 371/742] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:32 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1672 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:32.919162 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-a31b3a19-ceb2-4071-bf32-806373641da7 req-6ae40e70-2b0a-4d1f-b0bf-acc19e870833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a898b1b-5c82-41b1-8b68-0ad30a3516a1", "name": "network-vif-plugged", "status": "completed", "tag": "c4193921-efc0-4d0e-8a62-50ecf8de25b1"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:32.932220 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a31b3a19-ceb2-4071-bf32-806373641da7 req-6ae40e70-2b0a-4d1f-b0bf-acc19e870833 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:32.932730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a31b3a19-ceb2-4071-bf32-806373641da7 req-6ae40e70-2b0a-4d1f-b0bf-acc19e870833 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:32.933163 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a31b3a19-ceb2-4071-bf32-806373641da7 req-6ae40e70-2b0a-4d1f-b0bf-acc19e870833 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:32.945124 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-a31b3a19-ceb2-4071-bf32-806373641da7 req-6ae40e70-2b0a-4d1f-b0bf-acc19e870833 service nova] Creating event network-vif-plugged:c4193921-efc0-4d0e-8a62-50ecf8de25b1 for instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 on hv-cinder-79797 Oct 27 09:41:32.951687 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-a31b3a19-ceb2-4071-bf32-806373641da7 req-6ae40e70-2b0a-4d1f-b0bf-acc19e870833 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043588 Oct 27 09:41:32.952583 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 372/743] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:33.116834 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f8356630-7f47-4749-8dbf-6e0290e0f442 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:33.118176 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f8356630-7f47-4749-8dbf-6e0290e0f442 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:33.132943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8356630-7f47-4749-8dbf-6e0290e0f442 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:33.133449 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8356630-7f47-4749-8dbf-6e0290e0f442 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:33.134448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8356630-7f47-4749-8dbf-6e0290e0f442 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:33.138604 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8356630-7f47-4749-8dbf-6e0290e0f442 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:33.139118 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8356630-7f47-4749-8dbf-6e0290e0f442 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:33.140401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f8356630-7f47-4749-8dbf-6e0290e0f442 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:33.222551 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:33.232394 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:33.234890 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:33.236021 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-fa5aec99-d8d8-4ea7-a84b-d16b4076e55e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1404 microversion: 2.20 time: 0.472230 Oct 27 09:41:33.236978 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 372/744] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:32 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:33.446533 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f8356630-7f47-4749-8dbf-6e0290e0f442 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:33.455992 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f8356630-7f47-4749-8dbf-6e0290e0f442 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1725 microversion: 2.1 time: 0.347032 Oct 27 09:41:33.457320 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 373/745] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:33 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1725 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:33.482541 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-aded086e-a285-4c17-914b-683d2d9d0907 req-909cf341-3535-48e0-a0a3-5e5616510175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5232c748-ed0e-4ba8-a76d-1b8b9ffd523c", "name": "network-vif-deleted", "tag": "4aa69fa8-90ce-4e7e-909d-73d1c879dbeb"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:33.493247 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-aded086e-a285-4c17-914b-683d2d9d0907 req-909cf341-3535-48e0-a0a3-5e5616510175 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:33.494275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-aded086e-a285-4c17-914b-683d2d9d0907 req-909cf341-3535-48e0-a0a3-5e5616510175 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:33.494708 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-aded086e-a285-4c17-914b-683d2d9d0907 req-909cf341-3535-48e0-a0a3-5e5616510175 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:33.505996 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-aded086e-a285-4c17-914b-683d2d9d0907 req-909cf341-3535-48e0-a0a3-5e5616510175 service nova] Creating event network-vif-deleted:4aa69fa8-90ce-4e7e-909d-73d1c879dbeb for instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c on hv-cinder-79797 Oct 27 09:41:33.510937 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-aded086e-a285-4c17-914b-683d2d9d0907 req-909cf341-3535-48e0-a0a3-5e5616510175 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032011 Oct 27 09:41:33.511760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 373/746] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:33.570741 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c1938f4c-2720-462d-9560-e9799477602f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:33.571406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c1938f4c-2720-462d-9560-e9799477602f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:33.578542 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1938f4c-2720-462d-9560-e9799477602f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:33.579053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1938f4c-2720-462d-9560-e9799477602f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:33.579499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1938f4c-2720-462d-9560-e9799477602f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:33.580231 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1938f4c-2720-462d-9560-e9799477602f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:33.580739 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1938f4c-2720-462d-9560-e9799477602f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:33.581177 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1938f4c-2720-462d-9560-e9799477602f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:33.920570 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8e41d05b-ae90-45b4-9aeb-4ec4acde0431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:33.921474 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8e41d05b-ae90-45b4-9aeb-4ec4acde0431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:33.927820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e41d05b-ae90-45b4-9aeb-4ec4acde0431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:33.928584 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e41d05b-ae90-45b4-9aeb-4ec4acde0431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:33.929124 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e41d05b-ae90-45b4-9aeb-4ec4acde0431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:33.929934 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e41d05b-ae90-45b4-9aeb-4ec4acde0431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:33.930497 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e41d05b-ae90-45b4-9aeb-4ec4acde0431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:33.931088 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8e41d05b-ae90-45b4-9aeb-4ec4acde0431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:33.950531 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c1938f4c-2720-462d-9560-e9799477602f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:33.971933 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c1938f4c-2720-462d-9560-e9799477602f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1680 microversion: 2.1 time: 0.404903 Oct 27 09:41:33.983579 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 374/747] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:33 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1680 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:34.002434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-8e41d05b-ae90-45b4-9aeb-4ec4acde0431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:34.010947 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8e41d05b-ae90-45b4-9aeb-4ec4acde0431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1605 microversion: 2.1 time: 0.094530 Oct 27 09:41:34.011540 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 374/748] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:33 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:34.262655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:34.263535 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:34.274205 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:34.275268 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:34.275700 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:34.276420 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:34.277065 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:34.277487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:34.392832 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-165a1538-a2e7-4436-af57-afed75afbb3c req-583d7bdf-70e8-43ae-b684-2eb16bb12ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03530ba9-438a-41c2-8e0c-72e90cc316cc", "name": "network-vif-deleted", "tag": "f81ca8dc-6051-4c47-b0e0-cafd4fc292d1"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:34.402714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-165a1538-a2e7-4436-af57-afed75afbb3c req-583d7bdf-70e8-43ae-b684-2eb16bb12ca9 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:34.403242 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-165a1538-a2e7-4436-af57-afed75afbb3c req-583d7bdf-70e8-43ae-b684-2eb16bb12ca9 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:34.403671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-165a1538-a2e7-4436-af57-afed75afbb3c req-583d7bdf-70e8-43ae-b684-2eb16bb12ca9 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:34.415395 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-165a1538-a2e7-4436-af57-afed75afbb3c req-583d7bdf-70e8-43ae-b684-2eb16bb12ca9 service nova] Creating event network-vif-deleted:f81ca8dc-6051-4c47-b0e0-cafd4fc292d1 for instance 03530ba9-438a-41c2-8e0c-72e90cc316cc on hv-cinder-79797 Oct 27 09:41:34.427635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-165a1538-a2e7-4436-af57-afed75afbb3c req-583d7bdf-70e8-43ae-b684-2eb16bb12ca9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038294 Oct 27 09:41:34.428786 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 375/749] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:34.468596 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:34.481992 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3208e076-5a42-442f-9899-e2aed5df39a4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:34.482352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:34.483823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:34.484545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3208e076-5a42-442f-9899-e2aed5df39a4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:34.485384 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fe2c2f4c-1938-4d68-82b6-0cff40d04277 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1404 microversion: 2.20 time: 0.226922 Oct 27 09:41:34.486016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 375/750] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:34 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:34.493718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3208e076-5a42-442f-9899-e2aed5df39a4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:34.494181 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3208e076-5a42-442f-9899-e2aed5df39a4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:34.494622 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3208e076-5a42-442f-9899-e2aed5df39a4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:34.495322 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3208e076-5a42-442f-9899-e2aed5df39a4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:34.495949 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3208e076-5a42-442f-9899-e2aed5df39a4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:34.496572 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3208e076-5a42-442f-9899-e2aed5df39a4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:34.663743 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3208e076-5a42-442f-9899-e2aed5df39a4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:34.672423 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3208e076-5a42-442f-9899-e2aed5df39a4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1725 microversion: 2.1 time: 0.196324 Oct 27 09:41:34.673303 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 376/751] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:34 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:34.966804 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-1c976cbd-3e78-4d1a-8b3c-65b3cb48b0fe req-e9abb007-39a5-45ef-b412-945fb7556e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5232c748-ed0e-4ba8-a76d-1b8b9ffd523c", "name": "network-vif-unplugged", "status": "completed", "tag": "4aa69fa8-90ce-4e7e-909d-73d1c879dbeb"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:34.976694 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-1c976cbd-3e78-4d1a-8b3c-65b3cb48b0fe req-e9abb007-39a5-45ef-b412-945fb7556e86 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:34.977169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-1c976cbd-3e78-4d1a-8b3c-65b3cb48b0fe req-e9abb007-39a5-45ef-b412-945fb7556e86 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:34.978155 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-1c976cbd-3e78-4d1a-8b3c-65b3cb48b0fe req-e9abb007-39a5-45ef-b412-945fb7556e86 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:34.989179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-1c976cbd-3e78-4d1a-8b3c-65b3cb48b0fe req-e9abb007-39a5-45ef-b412-945fb7556e86 service nova] Creating event network-vif-unplugged:4aa69fa8-90ce-4e7e-909d-73d1c879dbeb for instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c on hv-cinder-79797 Oct 27 09:41:34.995118 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-1c976cbd-3e78-4d1a-8b3c-65b3cb48b0fe req-e9abb007-39a5-45ef-b412-945fb7556e86 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032006 Oct 27 09:41:34.995787 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 376/752] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:34.996595 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a2b61a44-c6d6-4425-94ea-a6e47b8db19e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:34.997220 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a2b61a44-c6d6-4425-94ea-a6e47b8db19e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:35.004123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a2b61a44-c6d6-4425-94ea-a6e47b8db19e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.004661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a2b61a44-c6d6-4425-94ea-a6e47b8db19e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.005134 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a2b61a44-c6d6-4425-94ea-a6e47b8db19e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.005830 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a2b61a44-c6d6-4425-94ea-a6e47b8db19e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.006445 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a2b61a44-c6d6-4425-94ea-a6e47b8db19e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.006880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a2b61a44-c6d6-4425-94ea-a6e47b8db19e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.035585 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:35.036284 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:35.044126 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.044645 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.045276 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.046060 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.046520 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.047013 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.075106 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a2b61a44-c6d6-4425-94ea-a6e47b8db19e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:35.083748 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a2b61a44-c6d6-4425-94ea-a6e47b8db19e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1325 microversion: 2.1 time: 0.092314 Oct 27 09:41:35.084338 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 377/753] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:34 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1325 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:35.084496 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.085253 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.085940 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.086468 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'fault' on Instance uuid 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:41:35.129395 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:35.137304 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ec4df515-f387-4b6a-bda1-185aec16ab6e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1327 microversion: 2.1 time: 0.106141 Oct 27 09:41:35.137882 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 377/754] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:35 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:35.511488 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:35.512093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:35.518583 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.519063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.519493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.520182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.520663 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.521088 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.655135 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:35.663606 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:35.665787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:35.666885 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-732d8027-a74a-47c1-9108-913683f690df tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1404 microversion: 2.20 time: 0.159528 Oct 27 09:41:35.667440 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 378/755] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:35 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:35.696149 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-33da96a3-8d02-47f2-aeb7-8e1e86324b24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:35.696839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-33da96a3-8d02-47f2-aeb7-8e1e86324b24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:35.703238 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-33da96a3-8d02-47f2-aeb7-8e1e86324b24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.703885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-33da96a3-8d02-47f2-aeb7-8e1e86324b24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.704319 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-33da96a3-8d02-47f2-aeb7-8e1e86324b24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.705079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-33da96a3-8d02-47f2-aeb7-8e1e86324b24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.705540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-33da96a3-8d02-47f2-aeb7-8e1e86324b24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.705966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-33da96a3-8d02-47f2-aeb7-8e1e86324b24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.856446 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-33da96a3-8d02-47f2-aeb7-8e1e86324b24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:35.864655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-33da96a3-8d02-47f2-aeb7-8e1e86324b24 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1731 microversion: 2.1 time: 0.172270 Oct 27 09:41:35.865223 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 378/756] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:35 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:35.887664 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a14bce15-1fad-4187-babe-c36188d865b0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:35.888156 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a14bce15-1fad-4187-babe-c36188d865b0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:35.894094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a14bce15-1fad-4187-babe-c36188d865b0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.894575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a14bce15-1fad-4187-babe-c36188d865b0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.895011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a14bce15-1fad-4187-babe-c36188d865b0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.895693 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a14bce15-1fad-4187-babe-c36188d865b0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:35.896145 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a14bce15-1fad-4187-babe-c36188d865b0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:35.896593 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a14bce15-1fad-4187-babe-c36188d865b0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:35.971747 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a14bce15-1fad-4187-babe-c36188d865b0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087836 Oct 27 09:41:35.972376 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 379/757] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Oct 27 09:41:35 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:36.106572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:36.107117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:36.113684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.114204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.114641 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.115338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.115796 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.116222 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.150374 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.151016 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.151814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.152276 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lazy-loading 'fault' on Instance uuid 03530ba9-438a-41c2-8e0c-72e90cc316cc {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:41:36.161230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:36.161849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:36.167903 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.168392 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.168990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.169694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.170149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.170575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.202424 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.202907 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.203346 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.203791 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'fault' on Instance uuid 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:41:36.231467 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:36.239374 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1c15e2ef-b10f-4461-b83c-6551f102a15f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1330 microversion: 2.1 time: 0.136767 Oct 27 09:41:36.240182 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 379/758] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:36 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1330 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:36.263403 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:36.272151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ec87ae13-9ed9-41a2-999d-399394c8702f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 200 len: 1327 microversion: 2.1 time: 0.114738 Oct 27 09:41:36.273392 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 380/759] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:36 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:36.692570 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:36.693187 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:36.701098 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.701667 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.702111 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.702814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.703270 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.703696 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.906532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:36.915026 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:36.917192 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:36.918445 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c8d5e38a-c3f1-4428-9c8e-d0fd80b3a50b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1596 microversion: 2.20 time: 0.229830 Oct 27 09:41:36.919348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 380/760] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:41:36 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1596 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:41:36.943690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4b2eaf70-b262-4ae5-8601-4e48358254ab tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:36.944143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4b2eaf70-b262-4ae5-8601-4e48358254ab tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:36.950343 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b2eaf70-b262-4ae5-8601-4e48358254ab tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.951103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b2eaf70-b262-4ae5-8601-4e48358254ab tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.951546 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b2eaf70-b262-4ae5-8601-4e48358254ab tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:36.952245 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b2eaf70-b262-4ae5-8601-4e48358254ab tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:36.952728 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b2eaf70-b262-4ae5-8601-4e48358254ab tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:36.953358 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b2eaf70-b262-4ae5-8601-4e48358254ab tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:37.027663 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-9fbea1df-f109-411e-b6a8-6fa66bf36ca9 req-e44a1c67-85c2-4af3-ad75-04ad436e1ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2612979-fbed-42ac-b725-265018416862", "tag": "3a528390-aec1-4a57-8443-f4bdcd15f187"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:37.038183 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9fbea1df-f109-411e-b6a8-6fa66bf36ca9 req-e44a1c67-85c2-4af3-ad75-04ad436e1ca1 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:37.038936 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9fbea1df-f109-411e-b6a8-6fa66bf36ca9 req-e44a1c67-85c2-4af3-ad75-04ad436e1ca1 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:37.039608 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9fbea1df-f109-411e-b6a8-6fa66bf36ca9 req-e44a1c67-85c2-4af3-ad75-04ad436e1ca1 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:37.055164 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-9fbea1df-f109-411e-b6a8-6fa66bf36ca9 req-e44a1c67-85c2-4af3-ad75-04ad436e1ca1 service nova] Creating event network-changed:3a528390-aec1-4a57-8443-f4bdcd15f187 for instance d2612979-fbed-42ac-b725-265018416862 on hv-cinder-79797 Oct 27 09:41:37.061470 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-9fbea1df-f109-411e-b6a8-6fa66bf36ca9 req-e44a1c67-85c2-4af3-ad75-04ad436e1ca1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038062 Oct 27 09:41:37.062063 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 381/761] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:37.067329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4b2eaf70-b262-4ae5-8601-4e48358254ab tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.127953 Oct 27 09:41:37.067989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 381/762] 10.222.0.70 () {60 vars in 1316 bytes} [Thu Oct 27 09:41:36 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:41:37.266895 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:37.268460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:37.278759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:37.279523 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:37.280188 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:37.282770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:37.283421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:37.284858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:37.298290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:37.299185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:37.309405 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:37.310680 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:37.312594 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:37.316468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:37.318185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:37.319511 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:37.349483 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] HTTP exception thrown: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Request method failure captured: Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c HTTP/1.1 Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEoE9vMrezrYrgpDoB-JIU0ai9jfRlsakZ4KZSHyMVXFvEteMLaep9-x2QkIEv_WAa7ld411vUXTdKRqcVHszWIRe0x7GfTJMBh9zGCPtsjIM-esQ8xnqY4yyXNmRTsHztkULkwoJl4N_kC_dr0K1p0hhuOsUydo2iInlWenoM5vGI Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:41:37.351567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 286df4c587d7408d988c4739f4ff923a Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:41:37.353369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '5232c748-ed0e-4ba8-a76d-1b8b9ffd523c'} Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:41:37.354323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:41:37.356904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:41:37.360229 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Returning 404 to user: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:41:37.361402 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-48d947d4-55ae-421a-8ea8-4a631fbbf6b9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 404 len: 111 microversion: 2.1 time: 0.067231 Oct 27 09:41:37.362530 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 382/763] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:37 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:41:37.372695 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c9d5070f-27a8-4731-a873-4e84d67f1cd3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '.version_select at 0x7f36492f91f0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:37.378695 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:37.380045 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:37.380902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:37.381518 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lazy-loading 'fault' on Instance uuid 03530ba9-438a-41c2-8e0c-72e90cc316cc {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:41:37.411034 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c9d5070f-27a8-4731-a873-4e84d67f1cd3 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956342945" status: 202 len: 0 microversion: 2.1 time: 0.044044 Oct 27 09:41:37.411945 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 383/764] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Oct 27 09:41:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956342945 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:41:37.489281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:37.500951 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ccdb139d-4d55-4baf-8e37-60ba20a6685a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 200 len: 1330 microversion: 2.1 time: 0.239441 Oct 27 09:41:37.516221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 382/765] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:37 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 1330 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:38.104330 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a20fc562-80d1-401a-baaf-4ac906770b3e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'create', calling method: .version_select at 0x7f36492613a0>, body: {"keypair": {"name": "tempest-keypair-1086131415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKd400RLknOk3pekzYc88FGnS5l7oV4WpiDgZkzV2PXG7j7pDM7K/PS4MSK7UaRV8Fezl6jq4+sPmSxSjkNV3ZbUyy1qX0CmmUjy6gkJDlVWMZeVR2HIQ9g9NN2GPnrgg=="}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:38.120222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-a20fc562-80d1-401a-baaf-4ac906770b3e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Getting quotas for project 71d1c4930a1b487eb3dca8fde6ce424a. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:41:38.124805 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-a20fc562-80d1-401a-baaf-4ac906770b3e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Getting quotas for user 286df4c587d7408d988c4739f4ff923a and project 71d1c4930a1b487eb3dca8fde6ce424a. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:41:38.146853 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a20fc562-80d1-401a-baaf-4ac906770b3e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047015 Oct 27 09:41:38.147443 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 384/766] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Oct 27 09:41:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:38.525310 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:38.525928 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:38.532002 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:38.532485 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:38.532944 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:38.533637 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:38.534100 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:38.534528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:38.547926 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc HTTP/1.1 Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:41:38.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:41:38.551131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '03530ba9-438a-41c2-8e0c-72e90cc316cc'} Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:41:38.552011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:41:38.553510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:41:38.554918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:41:38.554918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b07e8ee3-ff16-4bee-a0ca-45b179d539f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 404 len: 111 microversion: 2.1 time: 0.029537 Oct 27 09:41:38.554918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 383/767] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:38 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:41:38.560869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c85de395-29af-433c-b12d-1ef74fe533e5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '.version_select at 0x7f3649261040>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:38.581336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c85de395-29af-433c-b12d-1ef74fe533e5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672760961" status: 202 len: 0 microversion: 2.1 time: 0.024305 Oct 27 09:41:38.582482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 385/768] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Oct 27 09:41:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672760961 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:41:39.118930 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-31fe2742-e161-4a92-8054-e1d79d640c38 req-109a8e81-cd2b-4907-bc41-0689aec24a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2612979-fbed-42ac-b725-265018416862", "tag": "3a528390-aec1-4a57-8443-f4bdcd15f187"}, {"name": "network-changed", "server_uuid": "3a898b1b-5c82-41b1-8b68-0ad30a3516a1", "tag": "c4193921-efc0-4d0e-8a62-50ecf8de25b1"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:39.130497 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-31fe2742-e161-4a92-8054-e1d79d640c38 req-109a8e81-cd2b-4907-bc41-0689aec24a00 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:39.131609 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-31fe2742-e161-4a92-8054-e1d79d640c38 req-109a8e81-cd2b-4907-bc41-0689aec24a00 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:39.132272 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-31fe2742-e161-4a92-8054-e1d79d640c38 req-109a8e81-cd2b-4907-bc41-0689aec24a00 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:39.147223 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-31fe2742-e161-4a92-8054-e1d79d640c38 req-109a8e81-cd2b-4907-bc41-0689aec24a00 service nova] Creating event network-changed:3a528390-aec1-4a57-8443-f4bdcd15f187 for instance d2612979-fbed-42ac-b725-265018416862 on hv-cinder-79797 Oct 27 09:41:39.148100 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-31fe2742-e161-4a92-8054-e1d79d640c38 req-109a8e81-cd2b-4907-bc41-0689aec24a00 service nova] Creating event network-changed:c4193921-efc0-4d0e-8a62-50ecf8de25b1 for instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 on hv-cinder-79797 Oct 27 09:41:39.155768 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-31fe2742-e161-4a92-8054-e1d79d640c38 req-109a8e81-cd2b-4907-bc41-0689aec24a00 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040523 Oct 27 09:41:39.156650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 384/769] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:39.262827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-689fadeb-355c-40bc-9063-2f7b5a8da8f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: .version_select at 0x7f36492b2a60>, body: {"keypair": {"name": "tempest-keypair-1322837854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiVuPXsAZYGWTT2aDwtQMy/LtE+P+N1fwTuF7gcLc8dq+P5qzgNN1Yp2NCzAeYVeSUW404Oew4zImHWxrrPop5i1K4dKTrm3VybswHyhLdUrLCYqp7Q0XJk7YdGnDeLaQ=="}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:39.280176 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-689fadeb-355c-40bc-9063-2f7b5a8da8f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:41:39.284606 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-689fadeb-355c-40bc-9063-2f7b5a8da8f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for user f7d2c6275669404db608d714baeb0065 and project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:41:39.315239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-689fadeb-355c-40bc-9063-2f7b5a8da8f4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056820 Oct 27 09:41:39.316291 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 386/770] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Oct 27 09:41:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:40.798346 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1420138358", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15104d09-0e0f-4140-ae39-9239f083d338"}], "security_groups": [{"name": "tempest-securitygroup--1812580963"}], "key_name": "tempest-keypair-1322837854", "user_data": "}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:40.968558 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] validate_networks() for [('15104d09-0e0f-4140-ae39-9239f083d338', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:41:41.107573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-931470164", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "27e1c21a-a41e-4b69-8864-f162b04c2923"}], "security_groups": [{"name": "tempest-securitygroup--559711826"}], "key_name": "tempest-keypair-1086131415", "user_data": "}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:41.302631 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.network.neutron [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] validate_networks() for [('27e1c21a-a41e-4b69-8864-f162b04c2923', None, None, None, None, None)] {{(pid=125361) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:41:41.736793 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:41:41.737368 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:41:41.737847 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:41:41.738260 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:41:41.738676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:41:41.747957 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:41.748436 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:41.748906 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:41.749665 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:41.750122 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:41.750553 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:41.767206 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:41:41.771251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for user f7d2c6275669404db608d714baeb0065 and project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:41:41.782613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:41:41.785053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:41:41.836541 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-751422c5-a34c-41e3-a645-5311f88a0f13 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.044576 Oct 27 09:41:41.837211 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 385/771] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:41:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:41:41.848165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-51224bed-58ca-4b05-b1e1-2b520c7d5739 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:41.848884 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-51224bed-58ca-4b05-b1e1-2b520c7d5739 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:41.927880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-51224bed-58ca-4b05-b1e1-2b520c7d5739 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:41.936006 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-51224bed-58ca-4b05-b1e1-2b520c7d5739 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1242 microversion: 2.1 time: 0.091468 Oct 27 09:41:41.940038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 386/772] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:41 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:42.074775 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Flavor limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:41:42.075390 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Image limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:41:42.076304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Flavor pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:41:42.076926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Image pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:41:42.077210 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:41:42.087980 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:42.088468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:42.088926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:42.089804 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:42.090411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:42.091023 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:42.111265 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Getting quotas for project 71d1c4930a1b487eb3dca8fde6ce424a. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:41:42.115910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Getting quotas for user 286df4c587d7408d988c4739f4ff923a and project 71d1c4930a1b487eb3dca8fde6ce424a. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:41:42.127243 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Going to run 1 instances... {{(pid=125361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:41:42.129571 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:41:42.158198 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=5 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:42.178846 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-31f02849-aab3-4f94-8956-ad564e016e2b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.146735 Oct 27 09:41:42.179667 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 387/773] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:41:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:41:42.190553 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0d78b231-9ee0-436c-9b18-a7e0078729b6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:42.191165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0d78b231-9ee0-436c-9b18-a7e0078729b6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:42.246128 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0d78b231-9ee0-436c-9b18-a7e0078729b6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:42.253517 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0d78b231-9ee0-436c-9b18-a7e0078729b6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1237 microversion: 2.1 time: 0.066724 Oct 27 09:41:42.254197 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 387/774] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:42 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:42.959379 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-215a8925-8452-4586-979f-69739851054b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:42.960014 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-215a8925-8452-4586-979f-69739851054b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:42.967809 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-215a8925-8452-4586-979f-69739851054b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:42.968290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-215a8925-8452-4586-979f-69739851054b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:42.968761 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-215a8925-8452-4586-979f-69739851054b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:42.969442 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-215a8925-8452-4586-979f-69739851054b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:42.969889 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-215a8925-8452-4586-979f-69739851054b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:42.970309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-215a8925-8452-4586-979f-69739851054b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:43.036800 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-215a8925-8452-4586-979f-69739851054b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:43.046266 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-215a8925-8452-4586-979f-69739851054b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1294 microversion: 2.1 time: 0.091749 Oct 27 09:41:43.046844 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 388/775] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:42 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:43.279052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8edfe481-c4e7-4e58-8f1a-a177293155fb tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:43.280788 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8edfe481-c4e7-4e58-8f1a-a177293155fb tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:43.288595 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8edfe481-c4e7-4e58-8f1a-a177293155fb tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:43.289099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8edfe481-c4e7-4e58-8f1a-a177293155fb tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:43.289566 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8edfe481-c4e7-4e58-8f1a-a177293155fb tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:43.290300 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8edfe481-c4e7-4e58-8f1a-a177293155fb tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:43.290803 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8edfe481-c4e7-4e58-8f1a-a177293155fb tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:43.291228 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8edfe481-c4e7-4e58-8f1a-a177293155fb tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:43.371886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8edfe481-c4e7-4e58-8f1a-a177293155fb tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:43.379657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8edfe481-c4e7-4e58-8f1a-a177293155fb tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1289 microversion: 2.1 time: 0.105853 Oct 27 09:41:43.380225 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 388/776] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:43 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:44.070618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b91e9fb6-b31f-44b5-8373-60f12e5ccf45 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:44.071424 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b91e9fb6-b31f-44b5-8373-60f12e5ccf45 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:44.078786 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b91e9fb6-b31f-44b5-8373-60f12e5ccf45 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:44.079277 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b91e9fb6-b31f-44b5-8373-60f12e5ccf45 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:44.079704 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b91e9fb6-b31f-44b5-8373-60f12e5ccf45 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:44.080397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b91e9fb6-b31f-44b5-8373-60f12e5ccf45 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:44.080877 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b91e9fb6-b31f-44b5-8373-60f12e5ccf45 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:44.082816 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b91e9fb6-b31f-44b5-8373-60f12e5ccf45 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:44.403812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e175d1e3-6dac-436c-89bc-2c9f1325bcfc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:44.404587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e175d1e3-6dac-436c-89bc-2c9f1325bcfc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:44.411284 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e175d1e3-6dac-436c-89bc-2c9f1325bcfc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:44.411783 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e175d1e3-6dac-436c-89bc-2c9f1325bcfc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:44.412227 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e175d1e3-6dac-436c-89bc-2c9f1325bcfc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:44.412999 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e175d1e3-6dac-436c-89bc-2c9f1325bcfc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:44.413457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e175d1e3-6dac-436c-89bc-2c9f1325bcfc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:44.413888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e175d1e3-6dac-436c-89bc-2c9f1325bcfc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:44.434156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:44.700386 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b91e9fb6-b31f-44b5-8373-60f12e5ccf45 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:44.708808 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b91e9fb6-b31f-44b5-8373-60f12e5ccf45 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1368 microversion: 2.1 time: 0.641997 Oct 27 09:41:44.709499 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 389/777] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:44 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1368 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:44.725580 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e175d1e3-6dac-436c-89bc-2c9f1325bcfc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:44.733352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e175d1e3-6dac-436c-89bc-2c9f1325bcfc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1295 microversion: 2.1 time: 0.334015 Oct 27 09:41:44.734090 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 389/778] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:44 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1295 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:45.544184 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-9c6295a1-78ab-4b19-b69c-33d955b73c2e req-a0a7eb0f-7651-44d5-9136-3b343af42200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d59eaa9a-23ee-4664-bea0-d16de93dfa7f", "tag": "f156fae7-f5fd-48a7-ba37-040eb64d86ae"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:45.573042 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-9c6295a1-78ab-4b19-b69c-33d955b73c2e req-a0a7eb0f-7651-44d5-9136-3b343af42200 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:45.573525 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-9c6295a1-78ab-4b19-b69c-33d955b73c2e req-a0a7eb0f-7651-44d5-9136-3b343af42200 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:45.573958 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-9c6295a1-78ab-4b19-b69c-33d955b73c2e req-a0a7eb0f-7651-44d5-9136-3b343af42200 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:45.586082 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-9c6295a1-78ab-4b19-b69c-33d955b73c2e req-a0a7eb0f-7651-44d5-9136-3b343af42200 service nova] Creating event network-changed:f156fae7-f5fd-48a7-ba37-040eb64d86ae for instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f on hv-cinder-79797 Oct 27 09:41:45.593731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-9c6295a1-78ab-4b19-b69c-33d955b73c2e req-a0a7eb0f-7651-44d5-9136-3b343af42200 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054744 Oct 27 09:41:45.594513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 390/779] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:45.736412 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-434c2fff-a720-410c-b7c3-4f60e5b31d5a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:45.737096 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-434c2fff-a720-410c-b7c3-4f60e5b31d5a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:45.743635 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-434c2fff-a720-410c-b7c3-4f60e5b31d5a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:45.744404 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-434c2fff-a720-410c-b7c3-4f60e5b31d5a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:45.745088 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-434c2fff-a720-410c-b7c3-4f60e5b31d5a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:45.746045 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-434c2fff-a720-410c-b7c3-4f60e5b31d5a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:45.746702 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-434c2fff-a720-410c-b7c3-4f60e5b31d5a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:45.747320 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-434c2fff-a720-410c-b7c3-4f60e5b31d5a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:45.756430 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4e8217dc-fe79-4d9e-b034-acf5c86aadfe tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:45.757177 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4e8217dc-fe79-4d9e-b034-acf5c86aadfe tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:45.766843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e8217dc-fe79-4d9e-b034-acf5c86aadfe tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:45.767436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e8217dc-fe79-4d9e-b034-acf5c86aadfe tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:45.767964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e8217dc-fe79-4d9e-b034-acf5c86aadfe tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:45.770646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e8217dc-fe79-4d9e-b034-acf5c86aadfe tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:45.771212 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e8217dc-fe79-4d9e-b034-acf5c86aadfe tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:45.771913 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4e8217dc-fe79-4d9e-b034-acf5c86aadfe tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:46.111235 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-434c2fff-a720-410c-b7c3-4f60e5b31d5a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:46.118822 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-434c2fff-a720-410c-b7c3-4f60e5b31d5a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1368 microversion: 2.1 time: 0.386261 Oct 27 09:41:46.119391 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 390/780] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:45 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1368 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:46.198542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4e8217dc-fe79-4d9e-b034-acf5c86aadfe tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:46.206300 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4e8217dc-fe79-4d9e-b034-acf5c86aadfe tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1362 microversion: 2.1 time: 0.454639 Oct 27 09:41:46.206865 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 391/781] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:45 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:47.142432 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-57e881df-c9cf-494c-8a07-a5c006788497 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:47.143049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-57e881df-c9cf-494c-8a07-a5c006788497 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:47.149603 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e881df-c9cf-494c-8a07-a5c006788497 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:47.150085 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e881df-c9cf-494c-8a07-a5c006788497 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:47.150521 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e881df-c9cf-494c-8a07-a5c006788497 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:47.151221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e881df-c9cf-494c-8a07-a5c006788497 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:47.151675 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e881df-c9cf-494c-8a07-a5c006788497 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:47.152125 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-57e881df-c9cf-494c-8a07-a5c006788497 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:47.230891 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-85e877f7-b05c-4ada-85c3-05290ab825c5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:47.231602 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-85e877f7-b05c-4ada-85c3-05290ab825c5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:47.238300 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-85e877f7-b05c-4ada-85c3-05290ab825c5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:47.238883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-85e877f7-b05c-4ada-85c3-05290ab825c5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:47.239387 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-85e877f7-b05c-4ada-85c3-05290ab825c5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:47.240162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-85e877f7-b05c-4ada-85c3-05290ab825c5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:47.240756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-85e877f7-b05c-4ada-85c3-05290ab825c5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:47.241184 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-85e877f7-b05c-4ada-85c3-05290ab825c5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:47.292494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-57e881df-c9cf-494c-8a07-a5c006788497 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:47.300195 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-57e881df-c9cf-494c-8a07-a5c006788497 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1368 microversion: 2.1 time: 0.161649 Oct 27 09:41:47.300802 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 391/782] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:47 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:47.374427 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-85e877f7-b05c-4ada-85c3-05290ab825c5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:47.381937 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-85e877f7-b05c-4ada-85c3-05290ab825c5 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1362 microversion: 2.1 time: 0.155791 Oct 27 09:41:47.382502 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 392/783] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:47 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:47.654257 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-24d32b24-98e7-4af6-9827-3dc17322499d req-21384e59-dc3a-499c-921e-6f40a77f6a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cacbe115-560c-4934-acc5-ca08bcac81c7", "tag": "de6ac140-1998-47ee-b791-3c7089ad7377"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:47.660401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:47.664840 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-24d32b24-98e7-4af6-9827-3dc17322499d req-21384e59-dc3a-499c-921e-6f40a77f6a9e service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:47.665318 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-24d32b24-98e7-4af6-9827-3dc17322499d req-21384e59-dc3a-499c-921e-6f40a77f6a9e service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:47.665754 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-24d32b24-98e7-4af6-9827-3dc17322499d req-21384e59-dc3a-499c-921e-6f40a77f6a9e service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:47.678149 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-24d32b24-98e7-4af6-9827-3dc17322499d req-21384e59-dc3a-499c-921e-6f40a77f6a9e service nova] Creating event network-changed:de6ac140-1998-47ee-b791-3c7089ad7377 for instance cacbe115-560c-4934-acc5-ca08bcac81c7 on hv-cinder-79797 Oct 27 09:41:47.683221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-24d32b24-98e7-4af6-9827-3dc17322499d req-21384e59-dc3a-499c-921e-6f40a77f6a9e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032660 Oct 27 09:41:47.683821 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 392/784] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:48.323712 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-861f3b64-59b3-4ddd-b1f6-d4a6a330ce02 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:48.324262 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-861f3b64-59b3-4ddd-b1f6-d4a6a330ce02 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:48.330927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-861f3b64-59b3-4ddd-b1f6-d4a6a330ce02 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:48.331404 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-861f3b64-59b3-4ddd-b1f6-d4a6a330ce02 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:48.331835 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-861f3b64-59b3-4ddd-b1f6-d4a6a330ce02 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:48.332538 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-861f3b64-59b3-4ddd-b1f6-d4a6a330ce02 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:48.332987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-861f3b64-59b3-4ddd-b1f6-d4a6a330ce02 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:48.333409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-861f3b64-59b3-4ddd-b1f6-d4a6a330ce02 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:48.405603 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-cdbd92ed-7e62-4e83-b5c1-0d42ad2361dd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:48.406290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-cdbd92ed-7e62-4e83-b5c1-0d42ad2361dd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:48.412879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cdbd92ed-7e62-4e83-b5c1-0d42ad2361dd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:48.413150 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cdbd92ed-7e62-4e83-b5c1-0d42ad2361dd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:48.413586 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cdbd92ed-7e62-4e83-b5c1-0d42ad2361dd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:48.414281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cdbd92ed-7e62-4e83-b5c1-0d42ad2361dd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:48.415259 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cdbd92ed-7e62-4e83-b5c1-0d42ad2361dd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:48.415682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cdbd92ed-7e62-4e83-b5c1-0d42ad2361dd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:48.490161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-861f3b64-59b3-4ddd-b1f6-d4a6a330ce02 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:48.498567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-861f3b64-59b3-4ddd-b1f6-d4a6a330ce02 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1368 microversion: 2.1 time: 0.179437 Oct 27 09:41:48.499143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 393/785] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:48 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:48.552802 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cdbd92ed-7e62-4e83-b5c1-0d42ad2361dd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:48.561056 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-cdbd92ed-7e62-4e83-b5c1-0d42ad2361dd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1362 microversion: 2.1 time: 0.160399 Oct 27 09:41:48.561633 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 393/786] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:48 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:49.521408 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f3566163-401f-4ca8-a304-c5613ffe5f3d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:49.522026 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f3566163-401f-4ca8-a304-c5613ffe5f3d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:49.529091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3566163-401f-4ca8-a304-c5613ffe5f3d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:49.529571 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3566163-401f-4ca8-a304-c5613ffe5f3d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:49.530023 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3566163-401f-4ca8-a304-c5613ffe5f3d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:49.530698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3566163-401f-4ca8-a304-c5613ffe5f3d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:49.531147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3566163-401f-4ca8-a304-c5613ffe5f3d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:49.531569 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f3566163-401f-4ca8-a304-c5613ffe5f3d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:49.583499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1f63ca9b-d58f-41f9-9dc1-f0bf23a4da00 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:49.584115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1f63ca9b-d58f-41f9-9dc1-f0bf23a4da00 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:49.591562 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f63ca9b-d58f-41f9-9dc1-f0bf23a4da00 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:49.592056 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f63ca9b-d58f-41f9-9dc1-f0bf23a4da00 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:49.592497 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f63ca9b-d58f-41f9-9dc1-f0bf23a4da00 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:49.593269 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f63ca9b-d58f-41f9-9dc1-f0bf23a4da00 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:49.593726 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f63ca9b-d58f-41f9-9dc1-f0bf23a4da00 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:49.594159 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f63ca9b-d58f-41f9-9dc1-f0bf23a4da00 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:50.002277 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1f63ca9b-d58f-41f9-9dc1-f0bf23a4da00 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:50.005560 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f3566163-401f-4ca8-a304-c5613ffe5f3d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:50.010001 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1f63ca9b-d58f-41f9-9dc1-f0bf23a4da00 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1362 microversion: 2.1 time: 0.430444 Oct 27 09:41:50.010580 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 394/787] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:49 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:50.013665 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f3566163-401f-4ca8-a304-c5613ffe5f3d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1368 microversion: 2.1 time: 0.496072 Oct 27 09:41:50.014304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 394/788] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:49 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1368 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:51.033334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7e9c9446-1a86-47fe-bb21-55255628f222 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:51.034055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7e9c9446-1a86-47fe-bb21-55255628f222 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:51.035700 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-772fe0a2-e52e-45ea-a05e-6677b5516ff4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:51.036462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-772fe0a2-e52e-45ea-a05e-6677b5516ff4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:51.042752 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7e9c9446-1a86-47fe-bb21-55255628f222 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:51.043698 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7e9c9446-1a86-47fe-bb21-55255628f222 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:51.044333 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7e9c9446-1a86-47fe-bb21-55255628f222 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:51.045104 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-772fe0a2-e52e-45ea-a05e-6677b5516ff4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:51.045224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7e9c9446-1a86-47fe-bb21-55255628f222 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:51.045974 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-772fe0a2-e52e-45ea-a05e-6677b5516ff4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:51.046091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7e9c9446-1a86-47fe-bb21-55255628f222 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:51.046647 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7e9c9446-1a86-47fe-bb21-55255628f222 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:51.046761 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-772fe0a2-e52e-45ea-a05e-6677b5516ff4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:51.047604 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-772fe0a2-e52e-45ea-a05e-6677b5516ff4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:51.048063 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-772fe0a2-e52e-45ea-a05e-6677b5516ff4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:51.048480 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-772fe0a2-e52e-45ea-a05e-6677b5516ff4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:51.246421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7e9c9446-1a86-47fe-bb21-55255628f222 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:51.253075 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-772fe0a2-e52e-45ea-a05e-6677b5516ff4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:51.254601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7e9c9446-1a86-47fe-bb21-55255628f222 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1362 microversion: 2.1 time: 0.225363 Oct 27 09:41:51.255182 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 395/789] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:51 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:51.259601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-6d66fd8c-6e7f-43c4-9f7c-f9626b75e10e req-c62f6b13-8613-41da-8b3e-965db39fa5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d59eaa9a-23ee-4664-bea0-d16de93dfa7f", "name": "network-vif-plugged", "status": "completed", "tag": "f156fae7-f5fd-48a7-ba37-040eb64d86ae"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:51.260821 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-772fe0a2-e52e-45ea-a05e-6677b5516ff4 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1368 microversion: 2.1 time: 0.229372 Oct 27 09:41:51.261638 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 395/790] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:51 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:51.274300 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6d66fd8c-6e7f-43c4-9f7c-f9626b75e10e req-c62f6b13-8613-41da-8b3e-965db39fa5b3 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:51.274805 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6d66fd8c-6e7f-43c4-9f7c-f9626b75e10e req-c62f6b13-8613-41da-8b3e-965db39fa5b3 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:51.275239 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6d66fd8c-6e7f-43c4-9f7c-f9626b75e10e req-c62f6b13-8613-41da-8b3e-965db39fa5b3 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:51.286494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-6d66fd8c-6e7f-43c4-9f7c-f9626b75e10e req-c62f6b13-8613-41da-8b3e-965db39fa5b3 service nova] Creating event network-vif-plugged:f156fae7-f5fd-48a7-ba37-040eb64d86ae for instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f on hv-cinder-79797 Oct 27 09:41:51.291762 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-6d66fd8c-6e7f-43c4-9f7c-f9626b75e10e req-c62f6b13-8613-41da-8b3e-965db39fa5b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035434 Oct 27 09:41:51.292348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 396/791] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:52.277755 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0d50501d-e9ba-4cd4-8a34-b3038f84467c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:52.278369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0d50501d-e9ba-4cd4-8a34-b3038f84467c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:52.281244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:52.281505 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:52.282354 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=14 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:52.282895 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=10 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:52.287616 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-416b81f0-a299-47ea-8f26-077dd2811dc0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:52.288433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-416b81f0-a299-47ea-8f26-077dd2811dc0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:52.289039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0d50501d-e9ba-4cd4-8a34-b3038f84467c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:52.289183 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0d50501d-e9ba-4cd4-8a34-b3038f84467c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:52.290240 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0d50501d-e9ba-4cd4-8a34-b3038f84467c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:52.290939 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0d50501d-e9ba-4cd4-8a34-b3038f84467c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:52.291394 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0d50501d-e9ba-4cd4-8a34-b3038f84467c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:52.291933 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0d50501d-e9ba-4cd4-8a34-b3038f84467c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:52.296218 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-416b81f0-a299-47ea-8f26-077dd2811dc0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:52.296757 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-416b81f0-a299-47ea-8f26-077dd2811dc0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:52.297372 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-416b81f0-a299-47ea-8f26-077dd2811dc0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:52.298073 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-416b81f0-a299-47ea-8f26-077dd2811dc0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:52.298532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-416b81f0-a299-47ea-8f26-077dd2811dc0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:52.298960 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-416b81f0-a299-47ea-8f26-077dd2811dc0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:52.483978 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0d50501d-e9ba-4cd4-8a34-b3038f84467c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:52.487725 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:41:52.488174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-416b81f0-a299-47ea-8f26-077dd2811dc0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:52.493090 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0d50501d-e9ba-4cd4-8a34-b3038f84467c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1362 microversion: 2.1 time: 0.219117 Oct 27 09:41:52.493667 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 396/792] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:52 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:52.495955 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-416b81f0-a299-47ea-8f26-077dd2811dc0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1368 microversion: 2.1 time: 0.215374 Oct 27 09:41:52.496543 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 397/793] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:52 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:41:53.307617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-95c47741-de47-4555-9656-d15475ffc5e7 req-443bc928-889f-49c8-9449-afb9b2e44e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cacbe115-560c-4934-acc5-ca08bcac81c7", "name": "network-vif-plugged", "status": "completed", "tag": "de6ac140-1998-47ee-b791-3c7089ad7377"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:53.317910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-95c47741-de47-4555-9656-d15475ffc5e7 req-443bc928-889f-49c8-9449-afb9b2e44e30 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.318510 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-95c47741-de47-4555-9656-d15475ffc5e7 req-443bc928-889f-49c8-9449-afb9b2e44e30 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.318940 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-95c47741-de47-4555-9656-d15475ffc5e7 req-443bc928-889f-49c8-9449-afb9b2e44e30 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.331710 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-95c47741-de47-4555-9656-d15475ffc5e7 req-443bc928-889f-49c8-9449-afb9b2e44e30 service nova] Creating event network-vif-plugged:de6ac140-1998-47ee-b791-3c7089ad7377 for instance cacbe115-560c-4934-acc5-ca08bcac81c7 on hv-cinder-79797 Oct 27 09:41:53.336676 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-95c47741-de47-4555-9656-d15475ffc5e7 req-443bc928-889f-49c8-9449-afb9b2e44e30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033246 Oct 27 09:41:53.337269 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 397/794] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:53.515243 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-14d670af-ae2e-4c8f-91a2-06b9c3eb4ee0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:53.515848 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-14d670af-ae2e-4c8f-91a2-06b9c3eb4ee0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:53.519098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-51523fc7-5b37-4bf0-a6a5-5691caca8251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:53.519911 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-51523fc7-5b37-4bf0-a6a5-5691caca8251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:53.522160 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14d670af-ae2e-4c8f-91a2-06b9c3eb4ee0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.522709 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14d670af-ae2e-4c8f-91a2-06b9c3eb4ee0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.523213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14d670af-ae2e-4c8f-91a2-06b9c3eb4ee0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.523777 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14d670af-ae2e-4c8f-91a2-06b9c3eb4ee0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.524470 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14d670af-ae2e-4c8f-91a2-06b9c3eb4ee0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.524925 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14d670af-ae2e-4c8f-91a2-06b9c3eb4ee0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.528098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51523fc7-5b37-4bf0-a6a5-5691caca8251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.528753 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51523fc7-5b37-4bf0-a6a5-5691caca8251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.529271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51523fc7-5b37-4bf0-a6a5-5691caca8251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.530221 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51523fc7-5b37-4bf0-a6a5-5691caca8251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.530779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51523fc7-5b37-4bf0-a6a5-5691caca8251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.531331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51523fc7-5b37-4bf0-a6a5-5691caca8251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.693186 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-51523fc7-5b37-4bf0-a6a5-5691caca8251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:53.701761 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-51523fc7-5b37-4bf0-a6a5-5691caca8251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1559 microversion: 2.1 time: 0.187417 Oct 27 09:41:53.702432 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 398/795] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:53 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:53.725147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5ff785d4-f8f0-4bd7-889a-0fc30b68e514 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:53.725671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5ff785d4-f8f0-4bd7-889a-0fc30b68e514 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:53.731617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ff785d4-f8f0-4bd7-889a-0fc30b68e514 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.732093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ff785d4-f8f0-4bd7-889a-0fc30b68e514 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.732543 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ff785d4-f8f0-4bd7-889a-0fc30b68e514 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.733218 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ff785d4-f8f0-4bd7-889a-0fc30b68e514 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:53.733662 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ff785d4-f8f0-4bd7-889a-0fc30b68e514 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:53.734079 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ff785d4-f8f0-4bd7-889a-0fc30b68e514 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:53.829887 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5ff785d4-f8f0-4bd7-889a-0fc30b68e514 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108595 Oct 27 09:41:53.830506 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 399/796] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Oct 27 09:41:53 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:41:53.846765 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-14d670af-ae2e-4c8f-91a2-06b9c3eb4ee0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:53.854978 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-14d670af-ae2e-4c8f-91a2-06b9c3eb4ee0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1362 microversion: 2.1 time: 0.343576 Oct 27 09:41:53.855545 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 398/797] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:53 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:54.878658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-36652cb6-82bb-4ef0-9986-47ec33e81819 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:54.879271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-36652cb6-82bb-4ef0-9986-47ec33e81819 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:54.886112 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36652cb6-82bb-4ef0-9986-47ec33e81819 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:54.886597 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36652cb6-82bb-4ef0-9986-47ec33e81819 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:54.887045 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36652cb6-82bb-4ef0-9986-47ec33e81819 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:54.887723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36652cb6-82bb-4ef0-9986-47ec33e81819 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:54.888174 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36652cb6-82bb-4ef0-9986-47ec33e81819 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:54.888621 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36652cb6-82bb-4ef0-9986-47ec33e81819 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:54.998407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-6d7161e7-c226-45e7-84f6-e01d7a14d41d req-85774339-09cc-44bf-92e7-ade286db731a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d59eaa9a-23ee-4664-bea0-d16de93dfa7f", "tag": "f156fae7-f5fd-48a7-ba37-040eb64d86ae"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:55.008104 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6d7161e7-c226-45e7-84f6-e01d7a14d41d req-85774339-09cc-44bf-92e7-ade286db731a service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:55.008881 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6d7161e7-c226-45e7-84f6-e01d7a14d41d req-85774339-09cc-44bf-92e7-ade286db731a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:55.009415 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-6d7161e7-c226-45e7-84f6-e01d7a14d41d req-85774339-09cc-44bf-92e7-ade286db731a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:55.021463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-6d7161e7-c226-45e7-84f6-e01d7a14d41d req-85774339-09cc-44bf-92e7-ade286db731a service nova] Creating event network-changed:f156fae7-f5fd-48a7-ba37-040eb64d86ae for instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f on hv-cinder-79797 Oct 27 09:41:55.025575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-36652cb6-82bb-4ef0-9986-47ec33e81819 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:55.027235 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-6d7161e7-c226-45e7-84f6-e01d7a14d41d req-85774339-09cc-44bf-92e7-ade286db731a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032895 Oct 27 09:41:55.028122 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 399/798] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:55.033752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-36652cb6-82bb-4ef0-9986-47ec33e81819 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1362 microversion: 2.1 time: 0.159584 Oct 27 09:41:55.034329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 400/799] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:54 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:56.058648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-658ecadf-d049-4444-856e-21feb4c46c8a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:56.059272 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-658ecadf-d049-4444-856e-21feb4c46c8a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:56.065400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-658ecadf-d049-4444-856e-21feb4c46c8a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:56.065887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-658ecadf-d049-4444-856e-21feb4c46c8a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:56.066325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-658ecadf-d049-4444-856e-21feb4c46c8a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:56.067014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-658ecadf-d049-4444-856e-21feb4c46c8a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:56.067473 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-658ecadf-d049-4444-856e-21feb4c46c8a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:56.067897 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-658ecadf-d049-4444-856e-21feb4c46c8a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:56.202672 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-658ecadf-d049-4444-856e-21feb4c46c8a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:56.210338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-658ecadf-d049-4444-856e-21feb4c46c8a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1548 microversion: 2.1 time: 0.156469 Oct 27 09:41:56.210905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 400/800] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:56 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:56.232000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-21c7b0a2-a127-472a-95d0-c3a7508e514e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:56.232470 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-21c7b0a2-a127-472a-95d0-c3a7508e514e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:56.238779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-21c7b0a2-a127-472a-95d0-c3a7508e514e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:56.239253 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-21c7b0a2-a127-472a-95d0-c3a7508e514e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:56.239679 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-21c7b0a2-a127-472a-95d0-c3a7508e514e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:56.240351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-21c7b0a2-a127-472a-95d0-c3a7508e514e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:56.240832 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-21c7b0a2-a127-472a-95d0-c3a7508e514e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:56.241250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-21c7b0a2-a127-472a-95d0-c3a7508e514e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:56.319247 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-21c7b0a2-a127-472a-95d0-c3a7508e514e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090926 Oct 27 09:41:56.319843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 401/801] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Oct 27 09:41:56 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:57.219744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-b5c8ff8a-88ef-4254-9749-bd699375f7e2 req-df5cf8a8-896e-464f-939c-e39965f11a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cacbe115-560c-4934-acc5-ca08bcac81c7", "tag": "de6ac140-1998-47ee-b791-3c7089ad7377"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:57.230257 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b5c8ff8a-88ef-4254-9749-bd699375f7e2 req-df5cf8a8-896e-464f-939c-e39965f11a38 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:57.230724 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b5c8ff8a-88ef-4254-9749-bd699375f7e2 req-df5cf8a8-896e-464f-939c-e39965f11a38 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:57.231153 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b5c8ff8a-88ef-4254-9749-bd699375f7e2 req-df5cf8a8-896e-464f-939c-e39965f11a38 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:57.241834 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-b5c8ff8a-88ef-4254-9749-bd699375f7e2 req-df5cf8a8-896e-464f-939c-e39965f11a38 service nova] Creating event network-changed:de6ac140-1998-47ee-b791-3c7089ad7377 for instance cacbe115-560c-4934-acc5-ca08bcac81c7 on hv-cinder-79797 Oct 27 09:41:57.246636 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-b5c8ff8a-88ef-4254-9749-bd699375f7e2 req-df5cf8a8-896e-464f-939c-e39965f11a38 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030540 Oct 27 09:41:57.247414 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 401/802] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:41:58.141120 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e6732e88-bf2d-4448-87d7-50c0277c4c9b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:41:58.141779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e6732e88-bf2d-4448-87d7-50c0277c4c9b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:58.148017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e6732e88-bf2d-4448-87d7-50c0277c4c9b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:58.148500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e6732e88-bf2d-4448-87d7-50c0277c4c9b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:58.148964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e6732e88-bf2d-4448-87d7-50c0277c4c9b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:58.149666 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e6732e88-bf2d-4448-87d7-50c0277c4c9b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:58.150116 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e6732e88-bf2d-4448-87d7-50c0277c4c9b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:58.151084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e6732e88-bf2d-4448-87d7-50c0277c4c9b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:58.175567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-e6732e88-bf2d-4448-87d7-50c0277c4c9b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lazy-loading 'flavor' on Instance uuid 596c5c1c-3555-40e9-a2d3-6c6300478846 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:41:58.252336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e6732e88-bf2d-4448-87d7-50c0277c4c9b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "POST /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846/action" status: 202 len: 0 microversion: 2.1 time: 0.115573 Oct 27 09:41:58.252882 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 402/803] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:41:58 2022] POST /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:41:58.262705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c1dc58d0-2784-4977-9068-47e94bd9b246 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:58.264003 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c1dc58d0-2784-4977-9068-47e94bd9b246 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:58.270369 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1dc58d0-2784-4977-9068-47e94bd9b246 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:58.270864 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1dc58d0-2784-4977-9068-47e94bd9b246 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:58.271301 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1dc58d0-2784-4977-9068-47e94bd9b246 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:58.272010 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1dc58d0-2784-4977-9068-47e94bd9b246 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:58.272464 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1dc58d0-2784-4977-9068-47e94bd9b246 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:58.273181 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c1dc58d0-2784-4977-9068-47e94bd9b246 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:58.410437 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c1dc58d0-2784-4977-9068-47e94bd9b246 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:58.418217 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c1dc58d0-2784-4977-9068-47e94bd9b246 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.160838 Oct 27 09:41:58.418782 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 402/804] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:58 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:41:59.443430 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5af8e277-1923-43cb-8316-253872043ad4 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:41:59.444149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5af8e277-1923-43cb-8316-253872043ad4 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:41:59.450526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5af8e277-1923-43cb-8316-253872043ad4 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:59.450998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5af8e277-1923-43cb-8316-253872043ad4 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:59.451422 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5af8e277-1923-43cb-8316-253872043ad4 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:59.452093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5af8e277-1923-43cb-8316-253872043ad4 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:41:59.452557 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5af8e277-1923-43cb-8316-253872043ad4 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:41:59.452976 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5af8e277-1923-43cb-8316-253872043ad4 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:41:59.582262 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-5af8e277-1923-43cb-8316-253872043ad4 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:41:59.590466 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5af8e277-1923-43cb-8316-253872043ad4 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.151722 Oct 27 09:41:59.591037 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 403/805] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:41:59 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:00.613356 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1326fa3f-94d7-42ee-8176-0c61863de360 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:00.613971 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1326fa3f-94d7-42ee-8176-0c61863de360 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:00.621103 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1326fa3f-94d7-42ee-8176-0c61863de360 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:00.621589 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1326fa3f-94d7-42ee-8176-0c61863de360 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:00.622023 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1326fa3f-94d7-42ee-8176-0c61863de360 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:00.622707 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1326fa3f-94d7-42ee-8176-0c61863de360 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:00.623157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1326fa3f-94d7-42ee-8176-0c61863de360 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:00.623576 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1326fa3f-94d7-42ee-8176-0c61863de360 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:00.755327 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1326fa3f-94d7-42ee-8176-0c61863de360 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:00.763084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1326fa3f-94d7-42ee-8176-0c61863de360 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.153584 Oct 27 09:42:00.763902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 403/806] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:00 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:01.786685 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-07f0cef8-3daf-469c-9904-59aa1a40653b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:01.787328 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-07f0cef8-3daf-469c-9904-59aa1a40653b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:01.794374 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07f0cef8-3daf-469c-9904-59aa1a40653b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:01.794851 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07f0cef8-3daf-469c-9904-59aa1a40653b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:01.795284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07f0cef8-3daf-469c-9904-59aa1a40653b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:01.795971 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07f0cef8-3daf-469c-9904-59aa1a40653b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:01.796426 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07f0cef8-3daf-469c-9904-59aa1a40653b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:01.796879 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-07f0cef8-3daf-469c-9904-59aa1a40653b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:01.924216 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-07f0cef8-3daf-469c-9904-59aa1a40653b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:01.932480 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-07f0cef8-3daf-469c-9904-59aa1a40653b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.149658 Oct 27 09:42:01.933073 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 404/807] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:01 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:02.955414 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-67622f33-d4c3-4519-80c7-1bed9f705bea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:02.956031 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-67622f33-d4c3-4519-80c7-1bed9f705bea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:02.963182 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67622f33-d4c3-4519-80c7-1bed9f705bea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:02.963666 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67622f33-d4c3-4519-80c7-1bed9f705bea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:02.964101 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67622f33-d4c3-4519-80c7-1bed9f705bea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:02.964822 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67622f33-d4c3-4519-80c7-1bed9f705bea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:02.965283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67622f33-d4c3-4519-80c7-1bed9f705bea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:02.965707 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67622f33-d4c3-4519-80c7-1bed9f705bea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:03.097455 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-67622f33-d4c3-4519-80c7-1bed9f705bea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:03.105917 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-67622f33-d4c3-4519-80c7-1bed9f705bea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.154356 Oct 27 09:42:03.106477 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 404/808] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:02 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:04.129285 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2e4241d7-4d80-4371-864f-48d56edfb37a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:04.129973 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2e4241d7-4d80-4371-864f-48d56edfb37a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:04.136718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e4241d7-4d80-4371-864f-48d56edfb37a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:04.137203 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e4241d7-4d80-4371-864f-48d56edfb37a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:04.137639 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e4241d7-4d80-4371-864f-48d56edfb37a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:04.138331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e4241d7-4d80-4371-864f-48d56edfb37a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:04.138774 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e4241d7-4d80-4371-864f-48d56edfb37a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:04.139188 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2e4241d7-4d80-4371-864f-48d56edfb37a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:04.272987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2e4241d7-4d80-4371-864f-48d56edfb37a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:04.280743 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2e4241d7-4d80-4371-864f-48d56edfb37a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.155541 Oct 27 09:42:04.282023 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 405/809] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:04 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:05.303657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-04c1c25e-3b63-4535-a6e6-ae56d10c7bc8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:05.304264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-04c1c25e-3b63-4535-a6e6-ae56d10c7bc8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:05.310211 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04c1c25e-3b63-4535-a6e6-ae56d10c7bc8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:05.310686 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04c1c25e-3b63-4535-a6e6-ae56d10c7bc8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:05.311118 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04c1c25e-3b63-4535-a6e6-ae56d10c7bc8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:05.311799 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04c1c25e-3b63-4535-a6e6-ae56d10c7bc8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:05.312246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04c1c25e-3b63-4535-a6e6-ae56d10c7bc8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:05.312697 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04c1c25e-3b63-4535-a6e6-ae56d10c7bc8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:05.444712 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-04c1c25e-3b63-4535-a6e6-ae56d10c7bc8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:05.452707 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-04c1c25e-3b63-4535-a6e6-ae56d10c7bc8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.153016 Oct 27 09:42:05.453268 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 405/810] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:05 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:06.476256 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-18060d89-de1e-4dbe-8086-2a732354787f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:06.476883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-18060d89-de1e-4dbe-8086-2a732354787f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:06.483949 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-18060d89-de1e-4dbe-8086-2a732354787f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:06.484426 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-18060d89-de1e-4dbe-8086-2a732354787f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:06.484880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-18060d89-de1e-4dbe-8086-2a732354787f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:06.485564 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-18060d89-de1e-4dbe-8086-2a732354787f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:06.486038 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-18060d89-de1e-4dbe-8086-2a732354787f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:06.486455 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-18060d89-de1e-4dbe-8086-2a732354787f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:06.622674 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-18060d89-de1e-4dbe-8086-2a732354787f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:06.630406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-18060d89-de1e-4dbe-8086-2a732354787f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.158018 Oct 27 09:42:06.630971 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 406/811] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:06 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:07.653426 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-68d2eb77-0b4b-4d8c-b96b-f9f50ade5743 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:07.654037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-68d2eb77-0b4b-4d8c-b96b-f9f50ade5743 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:07.660811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-68d2eb77-0b4b-4d8c-b96b-f9f50ade5743 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:07.661291 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-68d2eb77-0b4b-4d8c-b96b-f9f50ade5743 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:07.661723 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-68d2eb77-0b4b-4d8c-b96b-f9f50ade5743 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:07.662406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-68d2eb77-0b4b-4d8c-b96b-f9f50ade5743 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:07.662857 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-68d2eb77-0b4b-4d8c-b96b-f9f50ade5743 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:07.663278 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-68d2eb77-0b4b-4d8c-b96b-f9f50ade5743 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:07.792487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-68d2eb77-0b4b-4d8c-b96b-f9f50ade5743 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:07.800165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-68d2eb77-0b4b-4d8c-b96b-f9f50ade5743 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.151047 Oct 27 09:42:07.800757 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 406/812] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:07 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:08.822802 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-563e72a7-e523-432c-b96c-74a4e980933f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:08.823348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-563e72a7-e523-432c-b96c-74a4e980933f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:08.830153 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-563e72a7-e523-432c-b96c-74a4e980933f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:08.830636 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-563e72a7-e523-432c-b96c-74a4e980933f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:08.831152 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-563e72a7-e523-432c-b96c-74a4e980933f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:08.831847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-563e72a7-e523-432c-b96c-74a4e980933f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:08.832310 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-563e72a7-e523-432c-b96c-74a4e980933f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:08.832769 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-563e72a7-e523-432c-b96c-74a4e980933f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:09.041523 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-563e72a7-e523-432c-b96c-74a4e980933f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:09.049716 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-563e72a7-e523-432c-b96c-74a4e980933f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.230867 Oct 27 09:42:09.050301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 407/813] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:08 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:10.041901 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-27f9488e-8d24-4929-b261-f4a195607fae tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1003713580"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:10.042401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-27f9488e-8d24-4929-b261-f4a195607fae tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:10.048838 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27f9488e-8d24-4929-b261-f4a195607fae tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:10.049312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27f9488e-8d24-4929-b261-f4a195607fae tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:10.049737 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27f9488e-8d24-4929-b261-f4a195607fae tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:10.050421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27f9488e-8d24-4929-b261-f4a195607fae tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:10.050867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27f9488e-8d24-4929-b261-f4a195607fae tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:10.051283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27f9488e-8d24-4929-b261-f4a195607fae tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:10.072819 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-51864f8e-cb79-44d7-99c3-c89305f8638c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:10.073437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-51864f8e-cb79-44d7-99c3-c89305f8638c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:10.079594 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51864f8e-cb79-44d7-99c3-c89305f8638c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:10.080081 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51864f8e-cb79-44d7-99c3-c89305f8638c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:10.080535 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51864f8e-cb79-44d7-99c3-c89305f8638c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:10.081231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51864f8e-cb79-44d7-99c3-c89305f8638c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:10.081691 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51864f8e-cb79-44d7-99c3-c89305f8638c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:10.082119 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51864f8e-cb79-44d7-99c3-c89305f8638c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:10.213661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.network.security_group_api [None req-27f9488e-8d24-4929-b261-f4a195607fae tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Removing security group b10bb2b0-1160-463d-b173-84e4e57babba from port 7969c643-a189-494b-ab3e-877a44420350 Oct 27 09:42:10.321690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-51864f8e-cb79-44d7-99c3-c89305f8638c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:10.329619 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-51864f8e-cb79-44d7-99c3-c89305f8638c tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.260806 Oct 27 09:42:10.330844 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 408/814] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:10 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:10.542009 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-27f9488e-8d24-4929-b261-f4a195607fae tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "POST /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/action" status: 202 len: 0 microversion: 2.1 time: 0.504477 Oct 27 09:42:10.546486 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 407/815] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:42:10 2022] POST /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:42:10.565288 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-1d60c170-131f-42a6-8a2f-619b5a826009 req-6e725dfd-e0bc-4e2d-940c-02fbba840576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc27f94-5b44-482f-9d13-b102e27b7a10", "tag": "7969c643-a189-494b-ab3e-877a44420350"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:10.579946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-1d60c170-131f-42a6-8a2f-619b5a826009 req-6e725dfd-e0bc-4e2d-940c-02fbba840576 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:10.580424 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-1d60c170-131f-42a6-8a2f-619b5a826009 req-6e725dfd-e0bc-4e2d-940c-02fbba840576 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:10.580869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-1d60c170-131f-42a6-8a2f-619b5a826009 req-6e725dfd-e0bc-4e2d-940c-02fbba840576 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:10.600588 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-1d60c170-131f-42a6-8a2f-619b5a826009 req-6e725dfd-e0bc-4e2d-940c-02fbba840576 service nova] Creating event network-changed:7969c643-a189-494b-ab3e-877a44420350 for instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 on hv-cinder-79797 Oct 27 09:42:10.615682 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-1d60c170-131f-42a6-8a2f-619b5a826009 req-6e725dfd-e0bc-4e2d-940c-02fbba840576 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059710 Oct 27 09:42:10.616292 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 409/816] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:11.353978 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-cbfade13-8b27-4aaa-b8c2-674f264c2352 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:11.354602 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-cbfade13-8b27-4aaa-b8c2-674f264c2352 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:11.360796 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cbfade13-8b27-4aaa-b8c2-674f264c2352 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:11.361191 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cbfade13-8b27-4aaa-b8c2-674f264c2352 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:11.361694 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cbfade13-8b27-4aaa-b8c2-674f264c2352 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:11.362538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cbfade13-8b27-4aaa-b8c2-674f264c2352 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:11.362999 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cbfade13-8b27-4aaa-b8c2-674f264c2352 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:11.363429 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cbfade13-8b27-4aaa-b8c2-674f264c2352 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:11.660850 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cbfade13-8b27-4aaa-b8c2-674f264c2352 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:11.669709 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-cbfade13-8b27-4aaa-b8c2-674f264c2352 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.320198 Oct 27 09:42:11.670615 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 408/817] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:11 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:12.022655 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3812b67c-5556-4329-8ffd-005b53b5f018 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:12.023326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3812b67c-5556-4329-8ffd-005b53b5f018 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:12.029470 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3812b67c-5556-4329-8ffd-005b53b5f018 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:12.029950 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3812b67c-5556-4329-8ffd-005b53b5f018 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:12.030376 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3812b67c-5556-4329-8ffd-005b53b5f018 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:12.031053 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3812b67c-5556-4329-8ffd-005b53b5f018 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:12.031496 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3812b67c-5556-4329-8ffd-005b53b5f018 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:12.031909 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3812b67c-5556-4329-8ffd-005b53b5f018 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:12.111596 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-3812b67c-5556-4329-8ffd-005b53b5f018 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lazy-loading 'services' on Instance uuid 1cc27f94-5b44-482f-9d13-b102e27b7a10 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:42:12.186794 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3812b67c-5556-4329-8ffd-005b53b5f018 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments/38d90438-fba9-48fb-813d-638ba347b4e5" status: 202 len: 0 microversion: 2.1 time: 0.168734 Oct 27 09:42:12.187713 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 410/818] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:42:12 2022] DELETE /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments/38d90438-fba9-48fb-813d-638ba347b4e5 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:42:12.199566 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b70d9083-d700-48cd-a6fa-981077355882 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:12.202913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b70d9083-d700-48cd-a6fa-981077355882 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:12.211096 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b70d9083-d700-48cd-a6fa-981077355882 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:12.211579 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b70d9083-d700-48cd-a6fa-981077355882 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:12.212015 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b70d9083-d700-48cd-a6fa-981077355882 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:12.212773 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b70d9083-d700-48cd-a6fa-981077355882 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:12.213222 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b70d9083-d700-48cd-a6fa-981077355882 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:12.213641 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b70d9083-d700-48cd-a6fa-981077355882 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:12.217792 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:12.245469 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b70d9083-d700-48cd-a6fa-981077355882 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052933 Oct 27 09:42:12.246038 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 409/819] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:12 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:12.686374 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-65b50c24-a023-4fb1-82cb-25679580a77f req-0fe1fb21-4a74-417e-ac10-d4f80ffe1cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc27f94-5b44-482f-9d13-b102e27b7a10", "tag": "7969c643-a189-494b-ab3e-877a44420350"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:12.694322 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-47a2f4b1-b99d-4d5f-b7c0-9cf0ab7f47b8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:12.694921 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-47a2f4b1-b99d-4d5f-b7c0-9cf0ab7f47b8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:12.701991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47a2f4b1-b99d-4d5f-b7c0-9cf0ab7f47b8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:12.702190 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-65b50c24-a023-4fb1-82cb-25679580a77f req-0fe1fb21-4a74-417e-ac10-d4f80ffe1cc7 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:12.702635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-65b50c24-a023-4fb1-82cb-25679580a77f req-0fe1fb21-4a74-417e-ac10-d4f80ffe1cc7 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:12.702836 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47a2f4b1-b99d-4d5f-b7c0-9cf0ab7f47b8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:12.703443 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47a2f4b1-b99d-4d5f-b7c0-9cf0ab7f47b8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:12.703575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-65b50c24-a023-4fb1-82cb-25679580a77f req-0fe1fb21-4a74-417e-ac10-d4f80ffe1cc7 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:12.704405 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47a2f4b1-b99d-4d5f-b7c0-9cf0ab7f47b8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:12.705035 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47a2f4b1-b99d-4d5f-b7c0-9cf0ab7f47b8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:12.705690 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-47a2f4b1-b99d-4d5f-b7c0-9cf0ab7f47b8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:12.718003 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-65b50c24-a023-4fb1-82cb-25679580a77f req-0fe1fb21-4a74-417e-ac10-d4f80ffe1cc7 service nova] Creating event network-changed:7969c643-a189-494b-ab3e-877a44420350 for instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 on hv-cinder-79797 Oct 27 09:42:12.723127 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-65b50c24-a023-4fb1-82cb-25679580a77f req-0fe1fb21-4a74-417e-ac10-d4f80ffe1cc7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095879 Oct 27 09:42:12.723731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 411/820] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:12.888773 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-47a2f4b1-b99d-4d5f-b7c0-9cf0ab7f47b8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:12.896593 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-47a2f4b1-b99d-4d5f-b7c0-9cf0ab7f47b8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1508 microversion: 2.1 time: 0.206053 Oct 27 09:42:12.897153 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 410/821] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:12 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:12.920943 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1e113676-aa7c-4b7b-a18e-77fd9a0fd80f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:12.921636 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1e113676-aa7c-4b7b-a18e-77fd9a0fd80f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:12.927797 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1e113676-aa7c-4b7b-a18e-77fd9a0fd80f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:12.928496 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1e113676-aa7c-4b7b-a18e-77fd9a0fd80f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:12.929131 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1e113676-aa7c-4b7b-a18e-77fd9a0fd80f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:12.929833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1e113676-aa7c-4b7b-a18e-77fd9a0fd80f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:12.930283 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1e113676-aa7c-4b7b-a18e-77fd9a0fd80f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:12.930705 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1e113676-aa7c-4b7b-a18e-77fd9a0fd80f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:12.964448 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1e113676-aa7c-4b7b-a18e-77fd9a0fd80f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125361) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 09:42:12.981892 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=53 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:13.017672 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:13.047701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1e113676-aa7c-4b7b-a18e-77fd9a0fd80f tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "POST /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846/action" status: 202 len: 0 microversion: 2.1 time: 0.130959 Oct 27 09:42:13.048340 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 412/822] 10.222.0.70 () {60 vars in 1278 bytes} [Thu Oct 27 09:42:12 2022] POST /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 09:42:13.056498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b83fb285-47fe-48db-9b65-97d037363ea7 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:13.057150 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b83fb285-47fe-48db-9b65-97d037363ea7 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:13.077853 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b83fb285-47fe-48db-9b65-97d037363ea7 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:13.078688 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b83fb285-47fe-48db-9b65-97d037363ea7 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:13.079531 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b83fb285-47fe-48db-9b65-97d037363ea7 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:13.080423 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b83fb285-47fe-48db-9b65-97d037363ea7 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:13.081100 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b83fb285-47fe-48db-9b65-97d037363ea7 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:13.081557 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b83fb285-47fe-48db-9b65-97d037363ea7 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:13.258845 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9b0c801c-2b30-44ac-be15-ad27985f3cb7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:13.262131 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9b0c801c-2b30-44ac-be15-ad27985f3cb7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:13.268379 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b0c801c-2b30-44ac-be15-ad27985f3cb7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:13.268908 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b0c801c-2b30-44ac-be15-ad27985f3cb7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:13.269353 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b0c801c-2b30-44ac-be15-ad27985f3cb7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:13.270147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b0c801c-2b30-44ac-be15-ad27985f3cb7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:13.270606 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b0c801c-2b30-44ac-be15-ad27985f3cb7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:13.271029 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b0c801c-2b30-44ac-be15-ad27985f3cb7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:13.303090 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9b0c801c-2b30-44ac-be15-ad27985f3cb7 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048314 Oct 27 09:42:13.303742 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 413/823] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:13 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:42:13.314794 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:13.315294 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:13.322089 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:13.322578 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:13.323009 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:13.323706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:13.324154 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:13.324598 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:13.402086 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] HTTP exception thrown: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 is not attached to volume 38d90438-fba9-48fb-813d-638ba347b4e5 Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Request method failure captured: Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: DELETE /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments/38d90438-fba9-48fb-813d-638ba347b4e5 HTTP/1.1 Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlGn6CsiK7mwZPhyKIK2Y4MIYVMAIO54bM1QHABn1CtUINcY5cUsx_yeBRnhLFqi7nKsA-ijWaoeop_0AtkqlHEvPNshyD-Mb-SKzfUyMN_xTNotlj3CVuHxdxa6X9bKpXi70bdFaiN9Rjk3EIr2AvCsotfWr7wFCYl_LF_7EuvwkGs Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: f169a47a4c9a4c60b87cedcd77c102c8 Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-TestMinimumBasicScenario-387822451 Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:42:13.404670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f169a47a4c9a4c60b87cedcd77c102c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f169a47a4c9a4c60b87cedcd77c102c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f169a47a4c9a4c60b87cedcd77c102c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f169a47a4c9a4c60b87cedcd77c102c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-TestMinimumBasicScenario-387822451 Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: f169a47a4c9a4c60b87cedcd77c102c8 Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-TestMinimumBasicScenario-387822451 Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-TestMinimumBasicScenario-387822451-project Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 51aba36d56c94e2fa351aa098dc0a962 Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-TestMinimumBasicScenario-387822451-project Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:42:13.406161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 is not attached to volume 38d90438-fba9-48fb-813d-638ba347b4e5 Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'server_id': '1cc27f94-5b44-482f-9d13-b102e27b7a10', 'id': '38d90438-fba9-48fb-813d-638ba347b4e5'} Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 38d90438-fba9-48fb-813d-638ba347b4e5. Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:42:13.406954 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 is not attached to volume 38d90438-fba9-48fb-813d-638ba347b4e5 Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 is not attached to volume 38d90438-fba9-48fb-813d-638ba347b4e5 Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:13.408415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Returning 404 to user: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 is not attached to volume 38d90438-fba9-48fb-813d-638ba347b4e5 {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:42:13.409616 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6b436a19-6f31-466c-bb36-7c5a3c942bbf tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments/38d90438-fba9-48fb-813d-638ba347b4e5" status: 404 len: 154 microversion: 2.1 time: 0.095433 Oct 27 09:42:13.409616 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 414/824] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:42:13 2022] DELETE /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10/os-volume_attachments/38d90438-fba9-48fb-813d-638ba347b4e5 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:42:13.558897 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b83fb285-47fe-48db-9b65-97d037363ea7 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:13.567455 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b83fb285-47fe-48db-9b65-97d037363ea7 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1516 microversion: 2.1 time: 0.514772 Oct 27 09:42:13.568282 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 411/825] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:13 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1516 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:14.550201 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-808521c4-a7a1-4cd4-8da4-2e3630d98f5d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:14.550786 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-808521c4-a7a1-4cd4-8da4-2e3630d98f5d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:14.557588 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-808521c4-a7a1-4cd4-8da4-2e3630d98f5d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:14.558069 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-808521c4-a7a1-4cd4-8da4-2e3630d98f5d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:14.558500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-808521c4-a7a1-4cd4-8da4-2e3630d98f5d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:14.559194 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-808521c4-a7a1-4cd4-8da4-2e3630d98f5d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:14.559648 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-808521c4-a7a1-4cd4-8da4-2e3630d98f5d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:14.560166 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-808521c4-a7a1-4cd4-8da4-2e3630d98f5d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:14.587057 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-808521c4-a7a1-4cd4-8da4-2e3630d98f5d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Going to try to terminate instance {{(pid=125361) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:42:14.592132 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4ae03344-5b06-45f7-a351-4a698a74c26d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:14.592908 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4ae03344-5b06-45f7-a351-4a698a74c26d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:14.599385 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ae03344-5b06-45f7-a351-4a698a74c26d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:14.599866 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ae03344-5b06-45f7-a351-4a698a74c26d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:14.600292 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ae03344-5b06-45f7-a351-4a698a74c26d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:14.601013 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ae03344-5b06-45f7-a351-4a698a74c26d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:14.601466 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ae03344-5b06-45f7-a351-4a698a74c26d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:14.601885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4ae03344-5b06-45f7-a351-4a698a74c26d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:14.671254 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-808521c4-a7a1-4cd4-8da4-2e3630d98f5d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 204 len: 0 microversion: 2.1 time: 0.124588 Oct 27 09:42:14.671843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 415/826] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:42:14 2022] DELETE /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:42:14.681363 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-eacb8b4e-e1ce-4611-ac47-748117ac1428 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:14.682904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-eacb8b4e-e1ce-4611-ac47-748117ac1428 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:14.690332 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eacb8b4e-e1ce-4611-ac47-748117ac1428 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:14.691064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eacb8b4e-e1ce-4611-ac47-748117ac1428 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:14.692083 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eacb8b4e-e1ce-4611-ac47-748117ac1428 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:14.692752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eacb8b4e-e1ce-4611-ac47-748117ac1428 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:14.693326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eacb8b4e-e1ce-4611-ac47-748117ac1428 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:14.693789 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-eacb8b4e-e1ce-4611-ac47-748117ac1428 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:14.773083 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4ae03344-5b06-45f7-a351-4a698a74c26d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:14.781629 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4ae03344-5b06-45f7-a351-4a698a74c26d tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1518 microversion: 2.1 time: 0.193927 Oct 27 09:42:14.782198 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 412/827] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:14 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:14.834790 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-eacb8b4e-e1ce-4611-ac47-748117ac1428 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:14.843051 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-eacb8b4e-e1ce-4611-ac47-748117ac1428 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1555 microversion: 2.1 time: 0.166735 Oct 27 09:42:14.843610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 416/828] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:14 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:15.152950 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-01d17b2e-3e2c-4e38-875a-49de488d4f2a req-f40934c7-a658-43b9-a787-848bed156c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596c5c1c-3555-40e9-a2d3-6c6300478846", "name": "network-vif-unplugged", "status": "completed", "tag": "af533890-8a09-4e93-ac93-881cbb38ca23"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:15.163781 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-01d17b2e-3e2c-4e38-875a-49de488d4f2a req-f40934c7-a658-43b9-a787-848bed156c2f service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:15.164398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-01d17b2e-3e2c-4e38-875a-49de488d4f2a req-f40934c7-a658-43b9-a787-848bed156c2f service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:15.164898 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-01d17b2e-3e2c-4e38-875a-49de488d4f2a req-f40934c7-a658-43b9-a787-848bed156c2f service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:15.176115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-01d17b2e-3e2c-4e38-875a-49de488d4f2a req-f40934c7-a658-43b9-a787-848bed156c2f service nova] Creating event network-vif-unplugged:af533890-8a09-4e93-ac93-881cbb38ca23 for instance 596c5c1c-3555-40e9-a2d3-6c6300478846 on hv-cinder-79797 Oct 27 09:42:15.181643 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-01d17b2e-3e2c-4e38-875a-49de488d4f2a req-f40934c7-a658-43b9-a787-848bed156c2f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032137 Oct 27 09:42:15.182222 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 413/829] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:15.805295 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a1250d81-2b6a-431c-bf2e-1a6bfff21ed8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:15.805900 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a1250d81-2b6a-431c-bf2e-1a6bfff21ed8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:15.812818 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1250d81-2b6a-431c-bf2e-1a6bfff21ed8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:15.813294 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1250d81-2b6a-431c-bf2e-1a6bfff21ed8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:15.813720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1250d81-2b6a-431c-bf2e-1a6bfff21ed8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:15.814395 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1250d81-2b6a-431c-bf2e-1a6bfff21ed8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:15.814838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1250d81-2b6a-431c-bf2e-1a6bfff21ed8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:15.815254 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1250d81-2b6a-431c-bf2e-1a6bfff21ed8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:15.867116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4c4b20e0-237d-451d-9d31-677628597078 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:15.868083 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4c4b20e0-237d-451d-9d31-677628597078 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:15.874922 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c4b20e0-237d-451d-9d31-677628597078 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:15.875400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c4b20e0-237d-451d-9d31-677628597078 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:15.875830 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c4b20e0-237d-451d-9d31-677628597078 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:15.876540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c4b20e0-237d-451d-9d31-677628597078 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:15.877004 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c4b20e0-237d-451d-9d31-677628597078 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:15.877452 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4c4b20e0-237d-451d-9d31-677628597078 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:15.989643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a1250d81-2b6a-431c-bf2e-1a6bfff21ed8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:15.998339 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a1250d81-2b6a-431c-bf2e-1a6bfff21ed8 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.196907 Oct 27 09:42:15.999268 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 417/830] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:15 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:16.032839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4c4b20e0-237d-451d-9d31-677628597078 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:16.040884 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4c4b20e0-237d-451d-9d31-677628597078 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1555 microversion: 2.1 time: 0.177998 Oct 27 09:42:16.041453 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 414/831] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:15 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:17.021941 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0a34e35b-a570-4195-a8db-9099a4abdf7b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:17.022724 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0a34e35b-a570-4195-a8db-9099a4abdf7b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:17.029173 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0a34e35b-a570-4195-a8db-9099a4abdf7b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:17.029726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0a34e35b-a570-4195-a8db-9099a4abdf7b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:17.030227 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0a34e35b-a570-4195-a8db-9099a4abdf7b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:17.030998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0a34e35b-a570-4195-a8db-9099a4abdf7b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:17.031520 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0a34e35b-a570-4195-a8db-9099a4abdf7b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:17.031949 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0a34e35b-a570-4195-a8db-9099a4abdf7b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:17.063229 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-123fb6ae-d92e-42fa-8e55-c9e30835cb9d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:17.063884 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-123fb6ae-d92e-42fa-8e55-c9e30835cb9d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:17.070243 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-123fb6ae-d92e-42fa-8e55-c9e30835cb9d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:17.070774 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-123fb6ae-d92e-42fa-8e55-c9e30835cb9d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:17.071426 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-123fb6ae-d92e-42fa-8e55-c9e30835cb9d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:17.072139 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-123fb6ae-d92e-42fa-8e55-c9e30835cb9d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:17.072621 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-123fb6ae-d92e-42fa-8e55-c9e30835cb9d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:17.073048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-123fb6ae-d92e-42fa-8e55-c9e30835cb9d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:17.315577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0a34e35b-a570-4195-a8db-9099a4abdf7b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:17.323741 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0a34e35b-a570-4195-a8db-9099a4abdf7b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.305529 Oct 27 09:42:17.324372 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 418/832] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:17 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:17.372975 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-123fb6ae-d92e-42fa-8e55-c9e30835cb9d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:17.381557 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-123fb6ae-d92e-42fa-8e55-c9e30835cb9d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1555 microversion: 2.1 time: 0.322197 Oct 27 09:42:17.382135 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 415/833] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:17 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1555 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:17.522638 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-c0b3a483-cbd5-4a56-a24c-f240fb615437 req-8679d6b0-3c3c-4ae6-8e67-125c8180016b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc27f94-5b44-482f-9d13-b102e27b7a10", "name": "network-vif-deleted", "tag": "7969c643-a189-494b-ab3e-877a44420350"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:17.533314 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-c0b3a483-cbd5-4a56-a24c-f240fb615437 req-8679d6b0-3c3c-4ae6-8e67-125c8180016b service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:17.533874 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-c0b3a483-cbd5-4a56-a24c-f240fb615437 req-8679d6b0-3c3c-4ae6-8e67-125c8180016b service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:17.534501 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-c0b3a483-cbd5-4a56-a24c-f240fb615437 req-8679d6b0-3c3c-4ae6-8e67-125c8180016b service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:17.546866 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-c0b3a483-cbd5-4a56-a24c-f240fb615437 req-8679d6b0-3c3c-4ae6-8e67-125c8180016b service nova] Creating event network-vif-deleted:7969c643-a189-494b-ab3e-877a44420350 for instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 on hv-cinder-79797 Oct 27 09:42:17.552811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-c0b3a483-cbd5-4a56-a24c-f240fb615437 req-8679d6b0-3c3c-4ae6-8e67-125c8180016b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033691 Oct 27 09:42:17.553392 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 419/834] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:18.055610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7f25432f-479c-4d29-b867-06f7ba7ce0d0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:18.056098 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7f25432f-479c-4d29-b867-06f7ba7ce0d0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:18.062142 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f25432f-479c-4d29-b867-06f7ba7ce0d0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:18.062620 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f25432f-479c-4d29-b867-06f7ba7ce0d0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:18.063053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f25432f-479c-4d29-b867-06f7ba7ce0d0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:18.063741 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f25432f-479c-4d29-b867-06f7ba7ce0d0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:18.064425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f25432f-479c-4d29-b867-06f7ba7ce0d0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:18.064653 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f25432f-479c-4d29-b867-06f7ba7ce0d0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:18.184684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-7f25432f-479c-4d29-b867-06f7ba7ce0d0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lazy-loading 'services' on Instance uuid d2612979-fbed-42ac-b725-265018416862 {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:42:18.299761 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7f25432f-479c-4d29-b867-06f7ba7ce0d0 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments/8c94c5a3-ef45-4079-98ad-2a7e7630cdf4" status: 202 len: 0 microversion: 2.1 time: 0.247945 Oct 27 09:42:18.300347 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 416/835] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:42:18 2022] DELETE /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments/8c94c5a3-ef45-4079-98ad-2a7e7630cdf4 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:42:18.309575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-abe479c0-593a-4b70-8741-3e89728904a5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:18.311854 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-abe479c0-593a-4b70-8741-3e89728904a5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:18.317875 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-abe479c0-593a-4b70-8741-3e89728904a5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:18.318348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-abe479c0-593a-4b70-8741-3e89728904a5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:18.318771 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-abe479c0-593a-4b70-8741-3e89728904a5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:18.319443 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-abe479c0-593a-4b70-8741-3e89728904a5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:18.319887 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-abe479c0-593a-4b70-8741-3e89728904a5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:18.320304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-abe479c0-593a-4b70-8741-3e89728904a5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:18.347740 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a5d5ef97-cfd3-40c8-8edc-ff5f424cebf3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:18.348439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a5d5ef97-cfd3-40c8-8edc-ff5f424cebf3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:18.350223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-abe479c0-593a-4b70-8741-3e89728904a5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Oct 27 09:42:18.350787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 420/836] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:18 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:18.354775 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5d5ef97-cfd3-40c8-8edc-ff5f424cebf3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:18.355268 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5d5ef97-cfd3-40c8-8edc-ff5f424cebf3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:18.355711 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5d5ef97-cfd3-40c8-8edc-ff5f424cebf3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:18.356439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5d5ef97-cfd3-40c8-8edc-ff5f424cebf3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:18.356922 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5d5ef97-cfd3-40c8-8edc-ff5f424cebf3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:18.357348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5d5ef97-cfd3-40c8-8edc-ff5f424cebf3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:18.404534 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:18.405167 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:18.411149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:18.411700 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:18.412205 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:18.412999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:18.413539 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:18.414040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:18.443831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:18.444306 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:18.444766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:18.445213 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lazy-loading 'fault' on Instance uuid 1cc27f94-5b44-482f-9d13-b102e27b7a10 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:42:18.497564 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51aba36d56c94e2fa351aa098dc0a962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f169a47a4c9a4c60b87cedcd77c102c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:18.505240 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1a45f62a-215b-4b34-a779-e507cd1e932c tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 200 len: 1348 microversion: 2.1 time: 0.105290 Oct 27 09:42:18.505808 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 421/837] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:18 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:18.522870 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a5d5ef97-cfd3-40c8-8edc-ff5f424cebf3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:18.531639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a5d5ef97-cfd3-40c8-8edc-ff5f424cebf3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.188085 Oct 27 09:42:18.532225 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 417/838] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:18 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:19.363013 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6632c9c1-fbc5-46cc-88fb-d65eaa9dc8e4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:19.365671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6632c9c1-fbc5-46cc-88fb-d65eaa9dc8e4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:19.372905 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6632c9c1-fbc5-46cc-88fb-d65eaa9dc8e4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:19.373315 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6632c9c1-fbc5-46cc-88fb-d65eaa9dc8e4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:19.373748 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6632c9c1-fbc5-46cc-88fb-d65eaa9dc8e4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:19.374615 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6632c9c1-fbc5-46cc-88fb-d65eaa9dc8e4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:19.375094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6632c9c1-fbc5-46cc-88fb-d65eaa9dc8e4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:19.375515 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6632c9c1-fbc5-46cc-88fb-d65eaa9dc8e4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:19.406733 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6632c9c1-fbc5-46cc-88fb-d65eaa9dc8e4 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047679 Oct 27 09:42:19.412796 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 422/839] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:19 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:42:19.493176 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-817ecb95-0334-4e29-afd4-3016377d9408 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:19.493713 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-817ecb95-0334-4e29-afd4-3016377d9408 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:19.496034 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=51 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:19.501250 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-817ecb95-0334-4e29-afd4-3016377d9408 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:19.501729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-817ecb95-0334-4e29-afd4-3016377d9408 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:19.502158 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-817ecb95-0334-4e29-afd4-3016377d9408 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:19.502840 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-817ecb95-0334-4e29-afd4-3016377d9408 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:19.503286 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-817ecb95-0334-4e29-afd4-3016377d9408 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:19.503706 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-817ecb95-0334-4e29-afd4-3016377d9408 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:19.529412 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:19.530019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] [instance: 1cc27f94-5b44-482f-9d13-b102e27b7a10] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:19.531892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-817ecb95-0334-4e29-afd4-3016377d9408 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:42:19.535865 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:19.536342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:19.536802 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:19.537483 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:19.537929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:19.538348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:19.552302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] HTTP exception thrown: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 could not be found. Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Request method failure captured: Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 HTTP/1.1 Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlGn6CsiK7mwZPhyKIK2Y4MIYVMAIO54bM1QHABn1CtUINcY5cUsx_yeBRnhLFqi7nKsA-ijWaoeop_0AtkqlHEvPNshyD-Mb-SKzfUyMN_xTNotlj3CVuHxdxa6X9bKpXi70bdFaiN9Rjk3EIr2AvCsotfWr7wFCYl_LF_7EuvwkGs Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: f169a47a4c9a4c60b87cedcd77c102c8 Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-TestMinimumBasicScenario-387822451 Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:42:19.553964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f169a47a4c9a4c60b87cedcd77c102c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f169a47a4c9a4c60b87cedcd77c102c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f169a47a4c9a4c60b87cedcd77c102c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f169a47a4c9a4c60b87cedcd77c102c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-TestMinimumBasicScenario-387822451 Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: f169a47a4c9a4c60b87cedcd77c102c8 Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-TestMinimumBasicScenario-387822451 Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-TestMinimumBasicScenario-387822451-project Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 51aba36d56c94e2fa351aa098dc0a962 Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-TestMinimumBasicScenario-387822451-project Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 could not be found. Oct 27 09:42:19.555275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '1cc27f94-5b44-482f-9d13-b102e27b7a10'} Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 could not be found. Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:42:19.559326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 could not be found. Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 could not be found. Oct 27 09:42:19.560868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:19.561989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Returning 404 to user: Instance 1cc27f94-5b44-482f-9d13-b102e27b7a10 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:42:19.561989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-744ebeee-36c5-43d7-853d-31e0cc20df4d tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10" status: 404 len: 111 microversion: 2.1 time: 0.030366 Oct 27 09:42:19.561989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 423/840] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:19 2022] GET /compute/v2.1/servers/1cc27f94-5b44-482f-9d13-b102e27b7a10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:42:19.561989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-115370c2-e674-4c66-93dd-e599f3d311c1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:19.561989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-115370c2-e674-4c66-93dd-e599f3d311c1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:19.566811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-115370c2-e674-4c66-93dd-e599f3d311c1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:19.567289 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-115370c2-e674-4c66-93dd-e599f3d311c1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:19.567766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-115370c2-e674-4c66-93dd-e599f3d311c1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:19.568643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-115370c2-e674-4c66-93dd-e599f3d311c1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:19.569263 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-115370c2-e674-4c66-93dd-e599f3d311c1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:19.569801 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-115370c2-e674-4c66-93dd-e599f3d311c1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:19.608000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-817ecb95-0334-4e29-afd4-3016377d9408 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 204 len: 0 microversion: 2.1 time: 0.118341 Oct 27 09:42:19.611652 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 418/841] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:42:19 2022] DELETE /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:42:19.614563 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a08a98ca-5b56-4e1e-a154-342499845d29 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] Calling method '.version_select at 0x7f36491cd5e0>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:19.635334 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a08a98ca-5b56-4e1e-a154-342499845d29 tempest-TestMinimumBasicScenario-387822451 tempest-TestMinimumBasicScenario-387822451-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1548663723" status: 202 len: 0 microversion: 2.1 time: 0.025116 Oct 27 09:42:19.635910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 419/842] 10.222.0.70 () {58 vars in 1272 bytes} [Thu Oct 27 09:42:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1548663723 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:42:19.641730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a2d4e65b-5087-4f17-82ff-6c0b75b0fcd1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:19.643111 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a2d4e65b-5087-4f17-82ff-6c0b75b0fcd1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:19.653728 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a2d4e65b-5087-4f17-82ff-6c0b75b0fcd1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:19.654349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a2d4e65b-5087-4f17-82ff-6c0b75b0fcd1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:19.654791 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a2d4e65b-5087-4f17-82ff-6c0b75b0fcd1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:19.655491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a2d4e65b-5087-4f17-82ff-6c0b75b0fcd1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:19.655947 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a2d4e65b-5087-4f17-82ff-6c0b75b0fcd1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:19.656368 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a2d4e65b-5087-4f17-82ff-6c0b75b0fcd1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:19.746450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-115370c2-e674-4c66-93dd-e599f3d311c1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:19.754130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-115370c2-e674-4c66-93dd-e599f3d311c1 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.197146 Oct 27 09:42:19.760803 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 424/843] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:19 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:19.812342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a2d4e65b-5087-4f17-82ff-6c0b75b0fcd1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:19.820147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a2d4e65b-5087-4f17-82ff-6c0b75b0fcd1 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1691 microversion: 2.1 time: 0.183281 Oct 27 09:42:19.820741 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 420/844] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:19 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:20.787940 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-31001c81-4a83-4606-bd3b-2b16dfe913f3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:20.788896 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-31001c81-4a83-4606-bd3b-2b16dfe913f3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:20.795323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31001c81-4a83-4606-bd3b-2b16dfe913f3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:20.795806 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31001c81-4a83-4606-bd3b-2b16dfe913f3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:20.796237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31001c81-4a83-4606-bd3b-2b16dfe913f3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:20.796959 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31001c81-4a83-4606-bd3b-2b16dfe913f3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:20.797413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31001c81-4a83-4606-bd3b-2b16dfe913f3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:20.797860 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-31001c81-4a83-4606-bd3b-2b16dfe913f3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:20.843808 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0bad66e6-eebe-4c3f-8331-197391a81387 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:20.844551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0bad66e6-eebe-4c3f-8331-197391a81387 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:20.851090 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0bad66e6-eebe-4c3f-8331-197391a81387 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:20.851655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0bad66e6-eebe-4c3f-8331-197391a81387 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:20.852170 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0bad66e6-eebe-4c3f-8331-197391a81387 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:20.853002 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0bad66e6-eebe-4c3f-8331-197391a81387 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:20.853521 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0bad66e6-eebe-4c3f-8331-197391a81387 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:20.854017 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0bad66e6-eebe-4c3f-8331-197391a81387 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:21.076548 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-31001c81-4a83-4606-bd3b-2b16dfe913f3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:21.084299 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-31001c81-4a83-4606-bd3b-2b16dfe913f3 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.310560 Oct 27 09:42:21.085415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 425/845] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:20 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:21.110117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0bad66e6-eebe-4c3f-8331-197391a81387 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:21.118079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0bad66e6-eebe-4c3f-8331-197391a81387 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1691 microversion: 2.1 time: 0.278127 Oct 27 09:42:21.119232 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 421/846] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:20 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1691 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:22.107291 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a3ad6416-eb3a-4fe7-9832-07fcf44090ea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:22.108577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a3ad6416-eb3a-4fe7-9832-07fcf44090ea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:22.114847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3ad6416-eb3a-4fe7-9832-07fcf44090ea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:22.115325 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3ad6416-eb3a-4fe7-9832-07fcf44090ea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:22.115752 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3ad6416-eb3a-4fe7-9832-07fcf44090ea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:22.121131 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3ad6416-eb3a-4fe7-9832-07fcf44090ea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:22.121865 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3ad6416-eb3a-4fe7-9832-07fcf44090ea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:22.122300 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3ad6416-eb3a-4fe7-9832-07fcf44090ea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:22.142609 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5eb468cb-64f2-4eba-9ed1-0152905d5c02 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:22.143218 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5eb468cb-64f2-4eba-9ed1-0152905d5c02 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:22.154492 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5eb468cb-64f2-4eba-9ed1-0152905d5c02 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:22.154902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5eb468cb-64f2-4eba-9ed1-0152905d5c02 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:22.155338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5eb468cb-64f2-4eba-9ed1-0152905d5c02 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:22.156047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5eb468cb-64f2-4eba-9ed1-0152905d5c02 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:22.156507 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5eb468cb-64f2-4eba-9ed1-0152905d5c02 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:22.156943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5eb468cb-64f2-4eba-9ed1-0152905d5c02 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:22.457241 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5eb468cb-64f2-4eba-9ed1-0152905d5c02 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:22.465923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5eb468cb-64f2-4eba-9ed1-0152905d5c02 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1691 microversion: 2.1 time: 0.327657 Oct 27 09:42:22.466492 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 422/847] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:22 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1691 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:22.482432 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a3ad6416-eb3a-4fe7-9832-07fcf44090ea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:22.491897 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a3ad6416-eb3a-4fe7-9832-07fcf44090ea tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.388389 Oct 27 09:42:22.505038 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 426/848] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:22 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:22.896543 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-cf423504-7a5a-484b-b1b2-079d2ff5ef45 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:22.897120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-cf423504-7a5a-484b-b1b2-079d2ff5ef45 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:22.903106 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf423504-7a5a-484b-b1b2-079d2ff5ef45 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:22.903653 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf423504-7a5a-484b-b1b2-079d2ff5ef45 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:22.904176 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf423504-7a5a-484b-b1b2-079d2ff5ef45 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:22.904997 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf423504-7a5a-484b-b1b2-079d2ff5ef45 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:22.905518 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf423504-7a5a-484b-b1b2-079d2ff5ef45 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:22.906002 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf423504-7a5a-484b-b1b2-079d2ff5ef45 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:22.929308 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-cf423504-7a5a-484b-b1b2-079d2ff5ef45 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/ips" status: 200 len: 151 microversion: 2.20 time: 0.092093 Oct 27 09:42:22.930057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 423/849] 10.222.0.70 () {60 vars in 1289 bytes} [Thu Oct 27 09:42:22 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:42:23.490675 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7d22f7b6-ca4c-41cc-9715-c7d89b2615d9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:23.491291 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7d22f7b6-ca4c-41cc-9715-c7d89b2615d9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:23.500473 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d22f7b6-ca4c-41cc-9715-c7d89b2615d9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:23.501214 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d22f7b6-ca4c-41cc-9715-c7d89b2615d9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:23.501575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d22f7b6-ca4c-41cc-9715-c7d89b2615d9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:23.502503 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d22f7b6-ca4c-41cc-9715-c7d89b2615d9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:23.503178 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d22f7b6-ca4c-41cc-9715-c7d89b2615d9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:23.503679 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7d22f7b6-ca4c-41cc-9715-c7d89b2615d9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:23.516508 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fd50e1e7-5d3e-40c5-9ae7-10aaa66a467a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:23.517918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fd50e1e7-5d3e-40c5-9ae7-10aaa66a467a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:23.526483 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fd50e1e7-5d3e-40c5-9ae7-10aaa66a467a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:23.527195 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fd50e1e7-5d3e-40c5-9ae7-10aaa66a467a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:23.527953 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fd50e1e7-5d3e-40c5-9ae7-10aaa66a467a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:23.528984 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fd50e1e7-5d3e-40c5-9ae7-10aaa66a467a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:23.529716 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fd50e1e7-5d3e-40c5-9ae7-10aaa66a467a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:23.530499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fd50e1e7-5d3e-40c5-9ae7-10aaa66a467a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:23.732101 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7d22f7b6-ca4c-41cc-9715-c7d89b2615d9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:23.740551 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7d22f7b6-ca4c-41cc-9715-c7d89b2615d9 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1691 microversion: 2.1 time: 0.254120 Oct 27 09:42:23.757835 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fd50e1e7-5d3e-40c5-9ae7-10aaa66a467a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:23.765749 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 427/850] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:23 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1691 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:23.766887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fd50e1e7-5d3e-40c5-9ae7-10aaa66a467a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.254318 Oct 27 09:42:23.767797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 424/851] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:23 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:24.763344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-01190dfb-2f5f-466d-b5f8-ec0f87e7bcfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:24.763991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-01190dfb-2f5f-466d-b5f8-ec0f87e7bcfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:24.770597 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-01190dfb-2f5f-466d-b5f8-ec0f87e7bcfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:24.771083 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-01190dfb-2f5f-466d-b5f8-ec0f87e7bcfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:24.771521 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-01190dfb-2f5f-466d-b5f8-ec0f87e7bcfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:24.772212 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-01190dfb-2f5f-466d-b5f8-ec0f87e7bcfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:24.772701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-01190dfb-2f5f-466d-b5f8-ec0f87e7bcfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:24.773127 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-01190dfb-2f5f-466d-b5f8-ec0f87e7bcfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:24.791801 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ef9f0664-fa20-4afd-92bc-95fe2e332fff tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:24.793105 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ef9f0664-fa20-4afd-92bc-95fe2e332fff tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:24.794930 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:24.800401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef9f0664-fa20-4afd-92bc-95fe2e332fff tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:24.801115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef9f0664-fa20-4afd-92bc-95fe2e332fff tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:24.801787 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef9f0664-fa20-4afd-92bc-95fe2e332fff tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:24.802714 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef9f0664-fa20-4afd-92bc-95fe2e332fff tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:24.803304 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef9f0664-fa20-4afd-92bc-95fe2e332fff tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:24.803833 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ef9f0664-fa20-4afd-92bc-95fe2e332fff tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:24.825692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:25.398703 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-01190dfb-2f5f-466d-b5f8-ec0f87e7bcfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:25.407304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-01190dfb-2f5f-466d-b5f8-ec0f87e7bcfa tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1691 microversion: 2.1 time: 0.647904 Oct 27 09:42:25.407869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 428/852] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:24 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1691 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:25.412689 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d2d9140b-8c6d-4d41-8406-9fe3c9de388c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:25.413411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d2d9140b-8c6d-4d41-8406-9fe3c9de388c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:25.419546 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d2d9140b-8c6d-4d41-8406-9fe3c9de388c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:25.420537 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d2d9140b-8c6d-4d41-8406-9fe3c9de388c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:25.421118 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d2d9140b-8c6d-4d41-8406-9fe3c9de388c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:25.421820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d2d9140b-8c6d-4d41-8406-9fe3c9de388c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:25.422365 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d2d9140b-8c6d-4d41-8406-9fe3c9de388c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:25.422883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d2d9140b-8c6d-4d41-8406-9fe3c9de388c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:25.423769 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ef9f0664-fa20-4afd-92bc-95fe2e332fff tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:25.433340 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ef9f0664-fa20-4afd-92bc-95fe2e332fff tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.645968 Oct 27 09:42:25.434094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 425/853] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:24 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:25.449526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-d2d9140b-8c6d-4d41-8406-9fe3c9de388c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lazy-loading 'flavor' on Instance uuid 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:42:25.669155 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d2d9140b-8c6d-4d41-8406-9fe3c9de388c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "POST /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/action" status: 202 len: 0 microversion: 2.20 time: 0.259750 Oct 27 09:42:25.669762 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 429/854] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Oct 27 09:42:25 2022] POST /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:42:25.678037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:25.678890 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:25.685444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:25.686860 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:25.687476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:25.688282 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:25.688911 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:25.689389 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:26.051472 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:26.060246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:26.061745 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:26.062936 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-707bfa4c-dd25-495f-b871-8060478bc3d8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.388924 Oct 27 09:42:26.063494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 426/855] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:25 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:26.399932 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-eff5f76d-10e4-4560-bf09-d5536888d878 req-f38f4adf-5c06-4769-9af0-d5920528177f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2612979-fbed-42ac-b725-265018416862", "name": "network-vif-deleted", "tag": "3a528390-aec1-4a57-8443-f4bdcd15f187"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:26.411047 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-eff5f76d-10e4-4560-bf09-d5536888d878 req-f38f4adf-5c06-4769-9af0-d5920528177f service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:26.411915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-eff5f76d-10e4-4560-bf09-d5536888d878 req-f38f4adf-5c06-4769-9af0-d5920528177f service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:26.412688 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-eff5f76d-10e4-4560-bf09-d5536888d878 req-f38f4adf-5c06-4769-9af0-d5920528177f service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:26.435579 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e5c32154-8bda-4494-8011-8f1366fbb798 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:26.436211 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e5c32154-8bda-4494-8011-8f1366fbb798 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:26.449022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e5c32154-8bda-4494-8011-8f1366fbb798 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:26.450411 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e5c32154-8bda-4494-8011-8f1366fbb798 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:26.451192 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e5c32154-8bda-4494-8011-8f1366fbb798 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:26.455120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e5c32154-8bda-4494-8011-8f1366fbb798 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:26.455900 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e5c32154-8bda-4494-8011-8f1366fbb798 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:26.457040 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e5c32154-8bda-4494-8011-8f1366fbb798 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:26.466605 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-eff5f76d-10e4-4560-bf09-d5536888d878 req-f38f4adf-5c06-4769-9af0-d5920528177f service nova] Creating event network-vif-deleted:3a528390-aec1-4a57-8443-f4bdcd15f187 for instance d2612979-fbed-42ac-b725-265018416862 on hv-cinder-79797 Oct 27 09:42:26.489287 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-eff5f76d-10e4-4560-bf09-d5536888d878 req-f38f4adf-5c06-4769-9af0-d5920528177f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087862 Oct 27 09:42:26.489981 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 430/856] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:26.510857 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-67fe7fe7-2ffc-4aa3-a891-da8c8758da43 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:26.516406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-67fe7fe7-2ffc-4aa3-a891-da8c8758da43 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:26.533904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fe7fe7-2ffc-4aa3-a891-da8c8758da43 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:26.534411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fe7fe7-2ffc-4aa3-a891-da8c8758da43 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:26.534849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fe7fe7-2ffc-4aa3-a891-da8c8758da43 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:26.535567 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fe7fe7-2ffc-4aa3-a891-da8c8758da43 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:26.542622 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fe7fe7-2ffc-4aa3-a891-da8c8758da43 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:26.543092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67fe7fe7-2ffc-4aa3-a891-da8c8758da43 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:26.600760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e5c32154-8bda-4494-8011-8f1366fbb798 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:26.619022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e5c32154-8bda-4494-8011-8f1366fbb798 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 200 len: 1331 microversion: 2.1 time: 0.186180 Oct 27 09:42:26.639515 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 427/857] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:26 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 1331 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:26.834765 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-67fe7fe7-2ffc-4aa3-a891-da8c8758da43 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:26.845874 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-67fe7fe7-2ffc-4aa3-a891-da8c8758da43 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.354108 Oct 27 09:42:26.849785 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 431/858] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:26 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:27.090025 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:27.091323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:27.098120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:27.098886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:27.099521 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:27.100424 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:27.101146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:27.101770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:27.283280 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:27.306267 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:27.310454 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:27.311975 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-eece009a-0a62-47f3-a646-934beabed76e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.225943 Oct 27 09:42:27.312621 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 428/859] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:27 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:27.645703 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:27.647091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: d2612979-fbed-42ac-b725-265018416862] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:27.657439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:27.658334 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:27.658971 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:27.660659 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:27.662406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:27.670682 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:27.688892 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] HTTP exception thrown: Instance d2612979-fbed-42ac-b725-265018416862 could not be found. Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Request method failure captured: Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 HTTP/1.1 Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEs5-tbzfNHaXrPO8RXRj9dewnCV2HOUd33_QWfCuKyBAx1Ix27FgqyKSHqu3c5HxuyE46MIa6u9OKbQgr2_gH2DdthtJSgHCsIx2TZb8X_KnoKljFtMa40Qmv-Uellj9bNNfFAaBQ2vKscoeJD-eIA3KY14nB7Y7QCgN9f6RkwKtc Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: df306d37ff634f7eaad80fc3bc65b653 Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:42:27.690883 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: df306d37ff634f7eaad80fc3bc65b653 Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-ServerRescueNegativeTestJSON-1374072368-project Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 20c65ed67cd8403489949c4dea572d01 Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1374072368-project Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance d2612979-fbed-42ac-b725-265018416862 could not be found. Oct 27 09:42:27.692618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': 'd2612979-fbed-42ac-b725-265018416862'} Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2612979-fbed-42ac-b725-265018416862 could not be found. Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:42:27.693460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2612979-fbed-42ac-b725-265018416862 could not be found. Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2612979-fbed-42ac-b725-265018416862 could not be found. Oct 27 09:42:27.694696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:27.695779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Returning 404 to user: Instance d2612979-fbed-42ac-b725-265018416862 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:42:27.695779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-19721ea1-7d36-4a2b-ad63-6c103f057789 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862" status: 404 len: 111 microversion: 2.1 time: 0.051479 Oct 27 09:42:27.695779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 432/860] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:27 2022] GET /compute/v2.1/servers/d2612979-fbed-42ac-b725-265018416862 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:42:27.702941 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5bc4a7c6-3888-4a65-9cac-f1cfb87f32e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '.version_select at 0x7f36493905e0>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:27.725856 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5bc4a7c6-3888-4a65-9cac-f1cfb87f32e5 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179485229" status: 202 len: 0 microversion: 2.1 time: 0.026806 Oct 27 09:42:27.726445 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 429/861] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Oct 27 09:42:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179485229 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:42:27.879147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c3b0e397-b3ad-421e-a54b-fe29652a0157 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:27.879147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c3b0e397-b3ad-421e-a54b-fe29652a0157 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:27.884847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3b0e397-b3ad-421e-a54b-fe29652a0157 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:27.885542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3b0e397-b3ad-421e-a54b-fe29652a0157 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:27.886501 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3b0e397-b3ad-421e-a54b-fe29652a0157 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:27.887502 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3b0e397-b3ad-421e-a54b-fe29652a0157 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:27.888433 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3b0e397-b3ad-421e-a54b-fe29652a0157 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:27.889041 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c3b0e397-b3ad-421e-a54b-fe29652a0157 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:28.254701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c3b0e397-b3ad-421e-a54b-fe29652a0157 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:28.277329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c3b0e397-b3ad-421e-a54b-fe29652a0157 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.404239 Oct 27 09:42:28.291262 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 433/862] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:27 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:28.340813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:28.342007 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:28.350463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:28.351185 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:28.353340 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:28.356430 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:28.357172 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:28.358916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:28.695764 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:28.705596 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:28.707051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:28.708218 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-88afa77e-8e4d-4fac-9a9e-66eb2c028bc3 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.371439 Oct 27 09:42:28.708819 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 430/863] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:28 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:29.303142 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-fc101d81-11d6-4e0f-90a1-82e28b1b1009 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:29.303746 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-fc101d81-11d6-4e0f-90a1-82e28b1b1009 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:29.310956 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fc101d81-11d6-4e0f-90a1-82e28b1b1009 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:29.311432 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fc101d81-11d6-4e0f-90a1-82e28b1b1009 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:29.311864 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fc101d81-11d6-4e0f-90a1-82e28b1b1009 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:29.312592 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fc101d81-11d6-4e0f-90a1-82e28b1b1009 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:29.313031 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fc101d81-11d6-4e0f-90a1-82e28b1b1009 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:29.313446 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fc101d81-11d6-4e0f-90a1-82e28b1b1009 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:29.457480 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-fc101d81-11d6-4e0f-90a1-82e28b1b1009 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:29.466098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-fc101d81-11d6-4e0f-90a1-82e28b1b1009 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.166728 Oct 27 09:42:29.480689 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 434/864] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:29 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:29.734467 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:29.735343 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:29.741781 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:29.742621 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:29.743974 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:29.744898 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:29.745522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:29.746235 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:29.765966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-b80d6be3-3457-4026-a0a0-bb55b0265473 req-24fa85b7-cf83-499e-8372-a3823e121d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596c5c1c-3555-40e9-a2d3-6c6300478846", "name": "network-vif-plugged", "status": "completed", "tag": "af533890-8a09-4e93-ac93-881cbb38ca23"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:29.778314 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b80d6be3-3457-4026-a0a0-bb55b0265473 req-24fa85b7-cf83-499e-8372-a3823e121d4d service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:29.778796 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b80d6be3-3457-4026-a0a0-bb55b0265473 req-24fa85b7-cf83-499e-8372-a3823e121d4d service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:29.779230 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-b80d6be3-3457-4026-a0a0-bb55b0265473 req-24fa85b7-cf83-499e-8372-a3823e121d4d service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:29.799336 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-b80d6be3-3457-4026-a0a0-bb55b0265473 req-24fa85b7-cf83-499e-8372-a3823e121d4d service nova] Creating event network-vif-plugged:af533890-8a09-4e93-ac93-881cbb38ca23 for instance 596c5c1c-3555-40e9-a2d3-6c6300478846 on hv-cinder-79797 Oct 27 09:42:29.807155 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-b80d6be3-3457-4026-a0a0-bb55b0265473 req-24fa85b7-cf83-499e-8372-a3823e121d4d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272838 Oct 27 09:42:29.808412 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 431/865] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:29.914217 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:29.941445 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:29.943126 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:29.944502 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-989bcb6d-c16d-4b3e-841a-a583c7b48fc9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.213836 Oct 27 09:42:29.945297 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 435/866] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:29 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:30.490307 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-209f392a-aad5-4b6b-90f5-95192f659690 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:30.491006 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-209f392a-aad5-4b6b-90f5-95192f659690 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:30.497251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209f392a-aad5-4b6b-90f5-95192f659690 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:30.497729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209f392a-aad5-4b6b-90f5-95192f659690 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:30.498161 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209f392a-aad5-4b6b-90f5-95192f659690 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:30.498847 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209f392a-aad5-4b6b-90f5-95192f659690 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:30.499299 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209f392a-aad5-4b6b-90f5-95192f659690 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:30.499721 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-209f392a-aad5-4b6b-90f5-95192f659690 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:30.627620 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-209f392a-aad5-4b6b-90f5-95192f659690 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:30.635780 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-209f392a-aad5-4b6b-90f5-95192f659690 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.149700 Oct 27 09:42:30.636349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 432/867] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:30 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:30.879381 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8cd1bba9-4295-4c52-b4c6-6a62b53fa7ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:30.879859 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8cd1bba9-4295-4c52-b4c6-6a62b53fa7ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:30.886936 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8cd1bba9-4295-4c52-b4c6-6a62b53fa7ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:30.887392 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8cd1bba9-4295-4c52-b4c6-6a62b53fa7ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:30.887852 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8cd1bba9-4295-4c52-b4c6-6a62b53fa7ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:30.888553 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8cd1bba9-4295-4c52-b4c6-6a62b53fa7ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:30.889005 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8cd1bba9-4295-4c52-b4c6-6a62b53fa7ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:30.889422 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8cd1bba9-4295-4c52-b4c6-6a62b53fa7ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:30.915778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8cd1bba9-4295-4c52-b4c6-6a62b53fa7ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Going to try to terminate instance {{(pid=125361) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:42:30.972020 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:30.972705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:30.978677 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:30.979152 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:30.979660 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:30.980360 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:30.980859 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:30.981264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:30.989458 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8cd1bba9-4295-4c52-b4c6-6a62b53fa7ca tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 204 len: 0 microversion: 2.1 time: 0.112643 Oct 27 09:42:30.990313 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 436/868] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:42:30 2022] DELETE /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:42:30.999739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-94e6ac4d-166e-4ae4-a1e6-8e00389b7ac8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:31.000460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-94e6ac4d-166e-4ae4-a1e6-8e00389b7ac8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:31.006459 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-94e6ac4d-166e-4ae4-a1e6-8e00389b7ac8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:31.006942 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-94e6ac4d-166e-4ae4-a1e6-8e00389b7ac8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:31.007369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-94e6ac4d-166e-4ae4-a1e6-8e00389b7ac8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:31.008056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-94e6ac4d-166e-4ae4-a1e6-8e00389b7ac8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:31.009131 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-94e6ac4d-166e-4ae4-a1e6-8e00389b7ac8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:31.009531 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-94e6ac4d-166e-4ae4-a1e6-8e00389b7ac8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:31.167042 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:31.174959 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:31.176380 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:31.177552 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c0e82c8d-9815-420f-b920-4f2b8685ed1e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.209507 Oct 27 09:42:31.180251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 433/869] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:30 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:42:31.188026 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-94e6ac4d-166e-4ae4-a1e6-8e00389b7ac8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:31.195787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-94e6ac4d-166e-4ae4-a1e6-8e00389b7ac8 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1507 microversion: 2.1 time: 0.200310 Oct 27 09:42:31.196963 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 437/870] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:30 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:31.659294 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-64aef199-4abf-437a-a3bf-19e559bc7910 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:31.659928 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-64aef199-4abf-437a-a3bf-19e559bc7910 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:31.666427 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64aef199-4abf-437a-a3bf-19e559bc7910 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:31.666912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64aef199-4abf-437a-a3bf-19e559bc7910 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:31.667352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64aef199-4abf-437a-a3bf-19e559bc7910 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:31.668044 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64aef199-4abf-437a-a3bf-19e559bc7910 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:31.668554 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64aef199-4abf-437a-a3bf-19e559bc7910 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:31.668976 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64aef199-4abf-437a-a3bf-19e559bc7910 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:31.801458 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-64aef199-4abf-437a-a3bf-19e559bc7910 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:31.809815 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-64aef199-4abf-437a-a3bf-19e559bc7910 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1574 microversion: 2.1 time: 0.154482 Oct 27 09:42:31.810383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 434/871] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:31 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:32.205884 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:32.206522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:32.213477 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:32.214043 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:32.214479 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:32.215166 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:32.215615 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:32.216720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:32.218959 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-80b81504-86c2-41f9-a082-79dadb1f06bd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:32.219578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-80b81504-86c2-41f9-a082-79dadb1f06bd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:32.225553 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b81504-86c2-41f9-a082-79dadb1f06bd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:32.226050 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b81504-86c2-41f9-a082-79dadb1f06bd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:32.226507 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b81504-86c2-41f9-a082-79dadb1f06bd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:32.227790 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b81504-86c2-41f9-a082-79dadb1f06bd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:32.228261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b81504-86c2-41f9-a082-79dadb1f06bd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:32.228718 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-80b81504-86c2-41f9-a082-79dadb1f06bd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:32.415719 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:32.419877 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-80b81504-86c2-41f9-a082-79dadb1f06bd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:32.424025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:32.426480 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:32.427844 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6ac1cbd9-55bf-4196-88b7-3879cf961e33 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.225646 Oct 27 09:42:32.427983 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-80b81504-86c2-41f9-a082-79dadb1f06bd tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1507 microversion: 2.1 time: 0.212837 Oct 27 09:42:32.434122 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 438/872] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:32 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:32.434272 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 435/873] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:32 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:32.833294 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-95292742-45a0-46ab-8cc7-3e30bd86091b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:32.834076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-95292742-45a0-46ab-8cc7-3e30bd86091b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:32.840127 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95292742-45a0-46ab-8cc7-3e30bd86091b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:32.840651 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95292742-45a0-46ab-8cc7-3e30bd86091b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:32.841084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95292742-45a0-46ab-8cc7-3e30bd86091b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:32.841780 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95292742-45a0-46ab-8cc7-3e30bd86091b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:32.842234 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95292742-45a0-46ab-8cc7-3e30bd86091b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:32.842657 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95292742-45a0-46ab-8cc7-3e30bd86091b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:33.285346 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-95292742-45a0-46ab-8cc7-3e30bd86091b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:33.293555 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-95292742-45a0-46ab-8cc7-3e30bd86091b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1561 microversion: 2.1 time: 0.464108 Oct 27 09:42:33.294125 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 439/874] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:32 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1561 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:33.453407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:33.454236 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:33.455701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ff5a7edb-6e7d-46b4-b191-16fa25f64dff tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:33.456313 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ff5a7edb-6e7d-46b4-b191-16fa25f64dff tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:33.462315 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:33.462578 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5a7edb-6e7d-46b4-b191-16fa25f64dff tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:33.463072 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5a7edb-6e7d-46b4-b191-16fa25f64dff tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:33.463479 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:33.463593 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5a7edb-6e7d-46b4-b191-16fa25f64dff tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:33.464180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5a7edb-6e7d-46b4-b191-16fa25f64dff tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:33.464438 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:33.464653 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5a7edb-6e7d-46b4-b191-16fa25f64dff tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:33.465076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff5a7edb-6e7d-46b4-b191-16fa25f64dff tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:33.465345 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:33.465967 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:33.466401 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:33.584664 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ff5a7edb-6e7d-46b4-b191-16fa25f64dff tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:33.594679 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ff5a7edb-6e7d-46b4-b191-16fa25f64dff tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 200 len: 1465 microversion: 2.1 time: 0.142711 Oct 27 09:42:33.596083 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 440/875] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:33 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 1465 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:33.667186 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-5cc801c2-a12a-4f64-9e57-aabe668ae837 req-708013b3-da8c-4618-bec3-9c7088691cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7180c7-c669-4b10-b463-9910c0eebbdd", "name": "network-vif-deleted", "tag": "8ce4a07b-23e9-45ec-a2f8-1e00ccb8e740"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:33.681075 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5cc801c2-a12a-4f64-9e57-aabe668ae837 req-708013b3-da8c-4618-bec3-9c7088691cfc service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:33.682285 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5cc801c2-a12a-4f64-9e57-aabe668ae837 req-708013b3-da8c-4618-bec3-9c7088691cfc service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:33.682841 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5cc801c2-a12a-4f64-9e57-aabe668ae837 req-708013b3-da8c-4618-bec3-9c7088691cfc service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:33.695281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:33.696331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-5cc801c2-a12a-4f64-9e57-aabe668ae837 req-708013b3-da8c-4618-bec3-9c7088691cfc service nova] Creating event network-vif-deleted:8ce4a07b-23e9-45ec-a2f8-1e00ccb8e740 for instance 9d7180c7-c669-4b10-b463-9910c0eebbdd on hv-cinder-79797 Oct 27 09:42:33.701491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-5cc801c2-a12a-4f64-9e57-aabe668ae837 req-708013b3-da8c-4618-bec3-9c7088691cfc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039782 Oct 27 09:42:33.702090 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 441/876] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:33.705877 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:33.707311 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:33.708544 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-455802ab-bd38-4bce-9af7-1c41ea42ad65 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.259721 Oct 27 09:42:33.712563 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 436/877] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:33 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:34.620403 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:34.621130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 9d7180c7-c669-4b10-b463-9910c0eebbdd] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:34.627209 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:34.627689 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:34.628123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:34.628841 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:34.629291 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:34.629710 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:34.643237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] HTTP exception thrown: Instance 9d7180c7-c669-4b10-b463-9910c0eebbdd could not be found. Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Request method failure captured: Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd HTTP/1.1 Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEs5-tbzfNHaXrPO8RXRj9dewnCV2HOUd33_QWfCuKyBAx1Ix27FgqyKSHqu3c5HxuyE46MIa6u9OKbQgr2_gH2DdthtJSgHCsIx2TZb8X_KnoKljFtMa40Qmv-Uellj9bNNfFAaBQ2vKscoeJD-eIA3KY14nB7Y7QCgN9f6RkwKtc Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: df306d37ff634f7eaad80fc3bc65b653 Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:42:34.644847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: df306d37ff634f7eaad80fc3bc65b653 Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-ServerRescueNegativeTestJSON-1374072368-project Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 20c65ed67cd8403489949c4dea572d01 Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1374072368-project Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 9d7180c7-c669-4b10-b463-9910c0eebbdd could not be found. Oct 27 09:42:34.646333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '9d7180c7-c669-4b10-b463-9910c0eebbdd'} Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d7180c7-c669-4b10-b463-9910c0eebbdd could not be found. Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:42:34.647162 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d7180c7-c669-4b10-b463-9910c0eebbdd could not be found. Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d7180c7-c669-4b10-b463-9910c0eebbdd could not be found. Oct 27 09:42:34.648542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:34.649756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Returning 404 to user: Instance 9d7180c7-c669-4b10-b463-9910c0eebbdd could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:42:34.649756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2329a034-9702-4355-a4b7-9bcb8ddc32ee tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd" status: 404 len: 111 microversion: 2.1 time: 0.031061 Oct 27 09:42:34.649756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 442/878] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:34 2022] GET /compute/v2.1/servers/9d7180c7-c669-4b10-b463-9910c0eebbdd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:42:34.654720 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-79ef9df1-cfb0-41dd-8c11-c50f17f09674 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:34.655274 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-79ef9df1-cfb0-41dd-8c11-c50f17f09674 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:34.661439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79ef9df1-cfb0-41dd-8c11-c50f17f09674 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:34.661925 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79ef9df1-cfb0-41dd-8c11-c50f17f09674 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:34.662370 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79ef9df1-cfb0-41dd-8c11-c50f17f09674 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:34.663064 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79ef9df1-cfb0-41dd-8c11-c50f17f09674 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:34.663529 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79ef9df1-cfb0-41dd-8c11-c50f17f09674 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:34.664053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79ef9df1-cfb0-41dd-8c11-c50f17f09674 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:34.688934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-79ef9df1-cfb0-41dd-8c11-c50f17f09674 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:42:34.734200 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:34.734804 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:34.740737 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:34.741272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:34.741637 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:34.742355 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:34.743401 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:34.743825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:34.767742 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-79ef9df1-cfb0-41dd-8c11-c50f17f09674 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 204 len: 0 microversion: 2.1 time: 0.116705 Oct 27 09:42:34.768439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 437/879] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:42:34 2022] DELETE /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:42:34.777128 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4bb906e2-b683-4865-9654-7bd9c033a94d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:34.777808 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4bb906e2-b683-4865-9654-7bd9c033a94d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:34.783750 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4bb906e2-b683-4865-9654-7bd9c033a94d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:34.784233 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4bb906e2-b683-4865-9654-7bd9c033a94d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:34.784689 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4bb906e2-b683-4865-9654-7bd9c033a94d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:34.785377 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4bb906e2-b683-4865-9654-7bd9c033a94d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:34.785825 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4bb906e2-b683-4865-9654-7bd9c033a94d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:34.786245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4bb906e2-b683-4865-9654-7bd9c033a94d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:34.926034 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:34.934711 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:34.936155 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:34.937322 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6e04b10f-66a7-43eb-a519-cfdd78a2bb9c tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.206917 Oct 27 09:42:34.937879 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 443/880] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:34 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:42:34.952813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4bb906e2-b683-4865-9654-7bd9c033a94d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:34.960602 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4bb906e2-b683-4865-9654-7bd9c033a94d tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.187743 Oct 27 09:42:34.961204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 438/881] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:34 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:35.963841 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:35.964371 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:35.970872 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:35.971342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:35.971767 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:35.972643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:35.973094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:35.973513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:35.978232 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:35.984374 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e6166ac0-792d-4086-a39d-3eb74610d3de tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:35.985015 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e6166ac0-792d-4086-a39d-3eb74610d3de tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:35.990879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6166ac0-792d-4086-a39d-3eb74610d3de tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:35.991360 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6166ac0-792d-4086-a39d-3eb74610d3de tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:35.991801 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6166ac0-792d-4086-a39d-3eb74610d3de tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:35.992493 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6166ac0-792d-4086-a39d-3eb74610d3de tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:35.992971 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6166ac0-792d-4086-a39d-3eb74610d3de tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:35.993421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e6166ac0-792d-4086-a39d-3eb74610d3de tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:36.161158 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:36.169867 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:36.171318 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:36.172543 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-45dc7e4d-a022-47e6-8500-ddf60cd3b62e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.213231 Oct 27 09:42:36.173096 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 444/882] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:35 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:36.182267 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e6166ac0-792d-4086-a39d-3eb74610d3de tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:36.190011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e6166ac0-792d-4086-a39d-3eb74610d3de tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.210146 Oct 27 09:42:36.190577 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 439/883] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:35 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:37.198297 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:37.199026 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:37.205729 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:37.206211 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:37.206642 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:37.207330 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:37.207796 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:37.208197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:37.214197 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ed186e9c-6ab6-4ead-8741-253de4201179 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:37.215347 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ed186e9c-6ab6-4ead-8741-253de4201179 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:37.221912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed186e9c-6ab6-4ead-8741-253de4201179 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:37.222403 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed186e9c-6ab6-4ead-8741-253de4201179 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:37.222843 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed186e9c-6ab6-4ead-8741-253de4201179 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:37.223770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed186e9c-6ab6-4ead-8741-253de4201179 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:37.224205 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed186e9c-6ab6-4ead-8741-253de4201179 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:37.224661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed186e9c-6ab6-4ead-8741-253de4201179 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:37.507645 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:37.512787 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ed186e9c-6ab6-4ead-8741-253de4201179 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20c65ed67cd8403489949c4dea572d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df306d37ff634f7eaad80fc3bc65b653', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:37.516226 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:37.517357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:37.518521 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9676e7b8-30e3-4cdf-8987-acbd77143f61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.324642 Oct 27 09:42:37.519288 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 445/884] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:37 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:37.520546 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ed186e9c-6ab6-4ead-8741-253de4201179 tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 200 len: 1522 microversion: 2.1 time: 0.310988 Oct 27 09:42:37.521290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 440/885] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:37 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:42:37.797025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-cab4758b-60a8-4496-9971-fab284d3384d req-9115279b-600d-4116-8142-8a1a723405e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed", "name": "network-vif-deleted", "tag": "27493571-2a5c-4be1-8467-ef2c9634fcc8"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:37.806293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-cab4758b-60a8-4496-9971-fab284d3384d req-9115279b-600d-4116-8142-8a1a723405e1 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:37.806767 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-cab4758b-60a8-4496-9971-fab284d3384d req-9115279b-600d-4116-8142-8a1a723405e1 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:37.807198 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-cab4758b-60a8-4496-9971-fab284d3384d req-9115279b-600d-4116-8142-8a1a723405e1 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:37.818269 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-cab4758b-60a8-4496-9971-fab284d3384d req-9115279b-600d-4116-8142-8a1a723405e1 service nova] Creating event network-vif-deleted:27493571-2a5c-4be1-8467-ef2c9634fcc8 for instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed on hv-cinder-79797 Oct 27 09:42:37.823976 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-cab4758b-60a8-4496-9971-fab284d3384d req-9115279b-600d-4116-8142-8a1a723405e1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030570 Oct 27 09:42:37.824892 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 446/886] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:38.543946 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:38.544557 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] [instance: 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:38.545997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:38.546700 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:38.551101 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:38.551584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:38.552014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:38.552744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:38.552852 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:38.553224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:38.553356 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:38.553613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:38.553717 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:38.554370 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:38.554824 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:38.555250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:38.569638 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] HTTP exception thrown: Instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed could not be found. Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Request method failure captured: Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed HTTP/1.1 Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEs5-tbzfNHaXrPO8RXRj9dewnCV2HOUd33_QWfCuKyBAx1Ix27FgqyKSHqu3c5HxuyE46MIa6u9OKbQgr2_gH2DdthtJSgHCsIx2TZb8X_KnoKljFtMa40Qmv-Uellj9bNNfFAaBQ2vKscoeJD-eIA3KY14nB7Y7QCgN9f6RkwKtc Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df306d37ff634f7eaad80fc3bc65b653 Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:42:38.571266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df306d37ff634f7eaad80fc3bc65b653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df306d37ff634f7eaad80fc3bc65b653 Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1374072368 Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-ServerRescueNegativeTestJSON-1374072368-project Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 20c65ed67cd8403489949c4dea572d01 Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1374072368-project Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed could not be found. Oct 27 09:42:38.572797 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed'} Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed could not be found. Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:42:38.573655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed could not be found. Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed could not be found. Oct 27 09:42:38.575289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:42:38.576498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] Returning 404 to user: Instance 4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:42:38.576498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-eb871768-a791-428a-80fd-f6ec1d6b36af tempest-ServerRescueNegativeTestJSON-1374072368 tempest-ServerRescueNegativeTestJSON-1374072368-project] 10.222.0.70 "GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed" status: 404 len: 111 microversion: 2.1 time: 0.033208 Oct 27 09:42:38.576498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 441/887] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:38 2022] GET /compute/v2.1/servers/4f9f1fc2-5de3-4524-9dcd-696a3dcfb7ed => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:42:38.691479 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:38.700016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:38.701485 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:38.702673 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a1793aac-1c47-4c72-a0d0-4bba8e80a5d2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.161903 Oct 27 09:42:38.703177 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 447/888] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:38 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:42:39.728731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:39.729339 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:39.736787 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:39.737570 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:39.738019 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:39.738737 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:39.739230 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:39.739787 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:39.877653 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:39.881369 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:39.888985 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:39.891052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:39.892622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-99ed14c1-b178-4f97-a203-06c188105d19 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.167789 Oct 27 09:42:39.893826 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 442/889] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:39 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:40.920279 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:40.922013 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:40.929731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:40.930489 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:40.931147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:40.932153 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:40.932957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:40.933556 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:41.083221 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:41.092380 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:41.093857 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:41.095049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9d9f3a93-52fc-4644-a693-1fd0defa5915 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.180328 Oct 27 09:42:41.095613 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 448/890] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:40 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:41.120509 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-21d14a78-938f-4749-91b9-616b5e437fce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:41.121094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-21d14a78-938f-4749-91b9-616b5e437fce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:41.129191 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21d14a78-938f-4749-91b9-616b5e437fce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:41.129681 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21d14a78-938f-4749-91b9-616b5e437fce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:41.130119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21d14a78-938f-4749-91b9-616b5e437fce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:41.130826 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21d14a78-938f-4749-91b9-616b5e437fce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:41.131308 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21d14a78-938f-4749-91b9-616b5e437fce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:41.131733 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-21d14a78-938f-4749-91b9-616b5e437fce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:41.161799 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-21d14a78-938f-4749-91b9-616b5e437fce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/ips" status: 200 len: 150 microversion: 2.1 time: 0.045905 Oct 27 09:42:41.162641 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 443/891] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Oct 27 09:42:41 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:42.122797 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:42.123500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:42.130825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:42.131696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:42.132498 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:42.132948 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:42.133530 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:42.134122 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:42.434185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:42.444086 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:42.446678 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:42.448767 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ec9e5e0e-f325-41ab-91b9-ec9b174b5456 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.330442 Oct 27 09:42:42.449812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 449/892] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:42 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:42.549299 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6b2b424e-71d5-471c-9bc2-d1ce8e937a71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce63e1d4-5856-40fb-aa2c-29c8762b2fff"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:42.552370 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6b2b424e-71d5-471c-9bc2-d1ce8e937a71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:42.558703 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b2b424e-71d5-471c-9bc2-d1ce8e937a71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:42.559191 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b2b424e-71d5-471c-9bc2-d1ce8e937a71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:42.559627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b2b424e-71d5-471c-9bc2-d1ce8e937a71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:42.560324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b2b424e-71d5-471c-9bc2-d1ce8e937a71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:42.560809 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b2b424e-71d5-471c-9bc2-d1ce8e937a71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:42.561228 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b2b424e-71d5-471c-9bc2-d1ce8e937a71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:42.818255 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6b2b424e-71d5-471c-9bc2-d1ce8e937a71 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272397 Oct 27 09:42:42.818872 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 444/893] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:42:42 2022] POST /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:43.477799 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:43.479216 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:43.481687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:43.486815 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:43.487301 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:43.487823 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:43.488564 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:43.489019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:43.489437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:43.625591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:43.633913 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:43.635404 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:43.636711 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4b992321-e701-4e72-bd37-016d19ddcdaf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.162833 Oct 27 09:42:43.637680 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 450/894] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:43 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:43.717786 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7df5f211-2c57-45f3-abf6-df311737e60c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:43.718357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7df5f211-2c57-45f3-abf6-df311737e60c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:43.725017 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7df5f211-2c57-45f3-abf6-df311737e60c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:43.725491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7df5f211-2c57-45f3-abf6-df311737e60c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:43.726128 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7df5f211-2c57-45f3-abf6-df311737e60c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:43.726813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7df5f211-2c57-45f3-abf6-df311737e60c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:43.727260 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7df5f211-2c57-45f3-abf6-df311737e60c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:43.727678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7df5f211-2c57-45f3-abf6-df311737e60c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:43.751549 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7df5f211-2c57-45f3-abf6-df311737e60c tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/ips" status: 200 len: 146 microversion: 2.1 time: 0.037815 Oct 27 09:42:43.752116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 445/895] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Oct 27 09:42:43 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:44.663224 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:44.663830 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:44.671053 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:44.671575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:44.672039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:44.672783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:44.673236 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:44.673659 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:44.803619 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:44.812345 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:44.813819 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:44.815006 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-95dc503b-8c9e-49a7-9f4c-3159f2c47ca7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.155748 Oct 27 09:42:44.815570 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 451/896] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:44 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:45.127408 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9fcfc00e-99e4-4348-99f8-946281ea55b4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b75e0ee-7c1d-47a1-be38-c05dc84b7df9"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:45.129858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9fcfc00e-99e4-4348-99f8-946281ea55b4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:45.136264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fcfc00e-99e4-4348-99f8-946281ea55b4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:45.136787 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fcfc00e-99e4-4348-99f8-946281ea55b4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:45.137226 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fcfc00e-99e4-4348-99f8-946281ea55b4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:45.137943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fcfc00e-99e4-4348-99f8-946281ea55b4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:45.138396 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fcfc00e-99e4-4348-99f8-946281ea55b4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:45.138820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fcfc00e-99e4-4348-99f8-946281ea55b4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:45.372500 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9fcfc00e-99e4-4348-99f8-946281ea55b4 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248860 Oct 27 09:42:45.373552 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 446/897] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:42:45 2022] POST /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:45.839364 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:45.839972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:45.846361 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:45.846843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:45.847278 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:45.847967 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:45.848418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:45.848872 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:46.005316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:46.014246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:46.015848 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:46.016897 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-7f7a1e3e-6ba2-49de-a0f6-010eb949d70f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.181419 Oct 27 09:42:46.017450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 452/898] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:45 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:47.044313 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:47.045047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:47.052590 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:47.053088 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:47.053533 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:47.054245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:47.054701 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:47.055133 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:47.217513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:47.233381 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:47.234668 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:47.235892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b5b594eb-8808-4f8f-9cc3-19922b04a1aa tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.196393 Oct 27 09:42:47.236905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 447/899] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:47 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:48.261333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:48.261968 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:48.268607 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:48.269092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:48.269522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:48.270205 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:48.270649 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:48.271066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:48.407297 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:48.416185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:48.417770 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:48.418964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9b9b6756-dcc1-43e2-aed7-ab9ce239d33e tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1741 microversion: 2.20 time: 0.161522 Oct 27 09:42:48.419624 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 453/900] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:48 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:49.448232 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:49.448912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:49.456383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:49.456905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:49.457348 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:49.458052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:49.458510 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:49.458940 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:49.651167 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:49.661109 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:49.663338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:49.665919 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9a28413b-a716-4285-af8e-62478e9db36d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1741 microversion: 2.20 time: 0.221687 Oct 27 09:42:49.667058 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 448/901] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:49 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:50.425601 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce63e1d4-5856-40fb-aa2c-29c8762b2fff"}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:50.428637 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:50.435346 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:50.435834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:50.436271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.437176 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:50.437636 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:50.438061 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.551851 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Invalid volume: volume ce63e1d4-5856-40fb-aa2c-29c8762b2fff is already attached to instances: d59eaa9a-23ee-4664-bea0-d16de93dfa7f Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: POST /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments HTTP/1.1 Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 74 Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:42:50.553895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {"volumeAttachment": {"volumeId": "ce63e1d4-5856-40fb-aa2c-29c8762b2fff"}} Oct 27 09:42:50.555544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Invalid volume: volume ce63e1d4-5856-40fb-aa2c-29c8762b2fff is already attached to instances: d59eaa9a-23ee-4664-bea0-d16de93dfa7f Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'server_id': 'd59eaa9a-23ee-4664-bea0-d16de93dfa7f', 'body': {'volumeAttachment': {'volumeId': 'ce63e1d4-5856-40fb-aa2c-29c8762b2fff'}}} Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce63e1d4-5856-40fb-aa2c-29c8762b2fff is already attached to instances: d59eaa9a-23ee-4664-bea0-d16de93dfa7f Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:50.556482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce63e1d4-5856-40fb-aa2c-29c8762b2fff is already attached to instances: d59eaa9a-23ee-4664-bea0-d16de93dfa7f Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:42:50.557814 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:42:50.562687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:42:50.562687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:42:50.562687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:42:50.562687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce63e1d4-5856-40fb-aa2c-29c8762b2fff is already attached to instances: d59eaa9a-23ee-4664-bea0-d16de93dfa7f Oct 27 09:42:50.562687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:42:50.562687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 400 to user: Invalid volume: volume ce63e1d4-5856-40fb-aa2c-29c8762b2fff is already attached to instances: d59eaa9a-23ee-4664-bea0-d16de93dfa7f {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:42:50.562687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-88cb86c4-77cb-41a2-9e13-a7ed3fd50be8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.133720 Oct 27 09:42:50.562687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 454/902] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:42:50 2022] POST /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:42:50.657861 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-088dacd0-3494-4ebc-b5ac-214669f5473f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:50.658365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-088dacd0-3494-4ebc-b5ac-214669f5473f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:50.660813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:50.667731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-088dacd0-3494-4ebc-b5ac-214669f5473f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:50.668509 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-088dacd0-3494-4ebc-b5ac-214669f5473f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:50.669171 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-088dacd0-3494-4ebc-b5ac-214669f5473f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.669961 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-088dacd0-3494-4ebc-b5ac-214669f5473f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:50.670425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-088dacd0-3494-4ebc-b5ac-214669f5473f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:50.670856 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-088dacd0-3494-4ebc-b5ac-214669f5473f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.693297 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:50.694222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:50.705479 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:50.706317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:50.706941 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.707853 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:50.708582 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:50.713152 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.784287 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-088dacd0-3494-4ebc-b5ac-214669f5473f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lazy-loading 'services' on Instance uuid d59eaa9a-23ee-4664-bea0-d16de93dfa7f {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:42:50.887594 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-088dacd0-3494-4ebc-b5ac-214669f5473f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments/ce63e1d4-5856-40fb-aa2c-29c8762b2fff" status: 202 len: 0 microversion: 2.1 time: 0.233606 Oct 27 09:42:50.891980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 449/903] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:42:50 2022] DELETE /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments/ce63e1d4-5856-40fb-aa2c-29c8762b2fff => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:42:50.904164 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0ea3bb95-3c1c-465a-a808-8aed4cea1db2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:50.907505 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0ea3bb95-3c1c-465a-a808-8aed4cea1db2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:50.916107 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0ea3bb95-3c1c-465a-a808-8aed4cea1db2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:50.916972 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0ea3bb95-3c1c-465a-a808-8aed4cea1db2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:50.917648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0ea3bb95-3c1c-465a-a808-8aed4cea1db2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.918696 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0ea3bb95-3c1c-465a-a808-8aed4cea1db2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:50.919415 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0ea3bb95-3c1c-465a-a808-8aed4cea1db2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:50.920022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0ea3bb95-3c1c-465a-a808-8aed4cea1db2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:50.967031 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0ea3bb95-3c1c-465a-a808-8aed4cea1db2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073122 Oct 27 09:42:50.972344 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 450/904] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:50 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:51.010815 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:51.022904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:51.025279 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:51.026727 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-29fe4d73-44d5-4bfa-a658-a314a77d8e2b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1736 microversion: 2.20 time: 0.337224 Oct 27 09:42:51.027635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 455/905] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:50 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1736 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:42:51.676324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-a9fe88e3-d0cc-4f38-8bd2-ff8b2a5b1195 req-c97fc085-8a28-490c-8697-5d087fd7dce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a898b1b-5c82-41b1-8b68-0ad30a3516a1", "name": "network-vif-plugged", "status": "completed", "tag": "c4193921-efc0-4d0e-8a62-50ecf8de25b1"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:51.692137 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a9fe88e3-d0cc-4f38-8bd2-ff8b2a5b1195 req-c97fc085-8a28-490c-8697-5d087fd7dce0 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:51.693029 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a9fe88e3-d0cc-4f38-8bd2-ff8b2a5b1195 req-c97fc085-8a28-490c-8697-5d087fd7dce0 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:51.693697 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a9fe88e3-d0cc-4f38-8bd2-ff8b2a5b1195 req-c97fc085-8a28-490c-8697-5d087fd7dce0 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:51.713514 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-a9fe88e3-d0cc-4f38-8bd2-ff8b2a5b1195 req-c97fc085-8a28-490c-8697-5d087fd7dce0 service nova] Creating event network-vif-plugged:c4193921-efc0-4d0e-8a62-50ecf8de25b1 for instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 on hv-cinder-79797 Oct 27 09:42:51.719968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-a9fe88e3-d0cc-4f38-8bd2-ff8b2a5b1195 req-c97fc085-8a28-490c-8697-5d087fd7dce0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047231 Oct 27 09:42:51.721339 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 451/906] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:51.982478 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9d4a474d-69f7-4ab9-940d-1f504f6e9a29 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:51.984850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9d4a474d-69f7-4ab9-940d-1f504f6e9a29 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:51.992773 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d4a474d-69f7-4ab9-940d-1f504f6e9a29 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:51.993848 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d4a474d-69f7-4ab9-940d-1f504f6e9a29 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:51.995371 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d4a474d-69f7-4ab9-940d-1f504f6e9a29 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:51.996426 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d4a474d-69f7-4ab9-940d-1f504f6e9a29 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:51.998029 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d4a474d-69f7-4ab9-940d-1f504f6e9a29 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:52.000078 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d4a474d-69f7-4ab9-940d-1f504f6e9a29 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:52.038964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9d4a474d-69f7-4ab9-940d-1f504f6e9a29 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063082 Oct 27 09:42:52.039763 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 456/907] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:51 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:52.054617 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:52.055509 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:52.063660 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:52.064428 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:52.065242 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:52.066120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:52.066815 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:52.067221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:52.226111 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:52.239640 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:52.241388 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:52.242730 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6ce9415f-0470-4bb3-a7ba-c1344a6c26a4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1736 microversion: 2.20 time: 0.193201 Oct 27 09:42:52.243501 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 452/908] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:52 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1736 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:53.052086 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b73fcc1d-40c4-4fc6-babc-9a0a8fe9127b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:53.054352 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b73fcc1d-40c4-4fc6-babc-9a0a8fe9127b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:53.063285 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b73fcc1d-40c4-4fc6-babc-9a0a8fe9127b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:53.064000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b73fcc1d-40c4-4fc6-babc-9a0a8fe9127b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:53.064427 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b73fcc1d-40c4-4fc6-babc-9a0a8fe9127b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:53.065151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b73fcc1d-40c4-4fc6-babc-9a0a8fe9127b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:53.065605 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b73fcc1d-40c4-4fc6-babc-9a0a8fe9127b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:53.066028 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b73fcc1d-40c4-4fc6-babc-9a0a8fe9127b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:53.098885 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b73fcc1d-40c4-4fc6-babc-9a0a8fe9127b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051321 Oct 27 09:42:53.099756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 457/909] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:53 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:53.285785 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:53.285785 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:53.293135 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:53.293655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:53.294074 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:53.294783 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:53.295235 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:53.295928 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:53.441090 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:53.454041 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:53.455847 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:53.457179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a18b7f2c-d1be-4b9c-8293-fef469fba2ba tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1736 microversion: 2.20 time: 0.191031 Oct 27 09:42:53.457933 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 453/910] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:53 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:54.115493 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-498ea947-ba5a-4507-9e38-dcb648418018 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:54.119107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-498ea947-ba5a-4507-9e38-dcb648418018 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:54.125832 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-498ea947-ba5a-4507-9e38-dcb648418018 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:54.126611 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-498ea947-ba5a-4507-9e38-dcb648418018 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:54.127316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-498ea947-ba5a-4507-9e38-dcb648418018 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:54.128186 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-498ea947-ba5a-4507-9e38-dcb648418018 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:54.128827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-498ea947-ba5a-4507-9e38-dcb648418018 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:54.129561 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-498ea947-ba5a-4507-9e38-dcb648418018 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:54.174013 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-498ea947-ba5a-4507-9e38-dcb648418018 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066486 Oct 27 09:42:54.175286 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 458/911] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:54 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:54.487675 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:54.492234 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:54.504862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:54.505639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:54.506161 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:54.506890 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:54.507433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:54.507962 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:54.687979 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:54.701109 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:54.706906 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:54.708424 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6a3e4c9c-30bc-4801-9d3e-be04ce50704d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1736 microversion: 2.20 time: 0.227948 Oct 27 09:42:54.724584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 454/912] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:54 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1736 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:55.187027 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cd22b2f8-a4e3-4482-b226-d2e002ea96ce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:55.189511 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cd22b2f8-a4e3-4482-b226-d2e002ea96ce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:55.203904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd22b2f8-a4e3-4482-b226-d2e002ea96ce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:55.204791 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd22b2f8-a4e3-4482-b226-d2e002ea96ce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:55.205576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd22b2f8-a4e3-4482-b226-d2e002ea96ce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:55.206573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd22b2f8-a4e3-4482-b226-d2e002ea96ce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:55.207138 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd22b2f8-a4e3-4482-b226-d2e002ea96ce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:55.208767 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cd22b2f8-a4e3-4482-b226-d2e002ea96ce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:55.283017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cd22b2f8-a4e3-4482-b226-d2e002ea96ce tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100023 Oct 27 09:42:55.284842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 459/913] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:55 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:55.734676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:55.735875 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:55.744027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:55.744893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:55.745682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:55.746782 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:55.747243 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:55.747834 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:55.903901 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:55.917923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:55.919576 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:55.921283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-956db85e-2478-40b0-8057-1d3c020a8b9f tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1736 microversion: 2.20 time: 0.190484 Oct 27 09:42:55.921988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 455/914] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:55 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1736 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:56.301333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-420e5fa5-7511-487f-b15c-a0f4e154a544 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:56.302133 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-420e5fa5-7511-487f-b15c-a0f4e154a544 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:56.311498 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420e5fa5-7511-487f-b15c-a0f4e154a544 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.311988 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420e5fa5-7511-487f-b15c-a0f4e154a544 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.312806 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420e5fa5-7511-487f-b15c-a0f4e154a544 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.313523 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420e5fa5-7511-487f-b15c-a0f4e154a544 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.313979 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420e5fa5-7511-487f-b15c-a0f4e154a544 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.314400 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-420e5fa5-7511-487f-b15c-a0f4e154a544 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.327250 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d1dcb8c0-d612-4967-b90f-ee247f324eb8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:56.328090 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d1dcb8c0-d612-4967-b90f-ee247f324eb8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:56.336503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d1dcb8c0-d612-4967-b90f-ee247f324eb8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.339049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d1dcb8c0-d612-4967-b90f-ee247f324eb8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.339601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d1dcb8c0-d612-4967-b90f-ee247f324eb8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.340846 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d1dcb8c0-d612-4967-b90f-ee247f324eb8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.341845 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d1dcb8c0-d612-4967-b90f-ee247f324eb8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.342548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d1dcb8c0-d612-4967-b90f-ee247f324eb8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.390658 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d1dcb8c0-d612-4967-b90f-ee247f324eb8 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081886 Oct 27 09:42:56.391012 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-420e5fa5-7511-487f-b15c-a0f4e154a544 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096581 Oct 27 09:42:56.391800 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 460/916] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:56 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:56.392033 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 456/916] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:56 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:56.403222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5c6fae90-ebd4-45bb-a83f-8a8c36f57014 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:56.403847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5c6fae90-ebd4-45bb-a83f-8a8c36f57014 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:56.409903 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5c6fae90-ebd4-45bb-a83f-8a8c36f57014 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.410553 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5c6fae90-ebd4-45bb-a83f-8a8c36f57014 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.410895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5c6fae90-ebd4-45bb-a83f-8a8c36f57014 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.411585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5c6fae90-ebd4-45bb-a83f-8a8c36f57014 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.412033 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5c6fae90-ebd4-45bb-a83f-8a8c36f57014 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.412454 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5c6fae90-ebd4-45bb-a83f-8a8c36f57014 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.431212 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:56.449783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5c6fae90-ebd4-45bb-a83f-8a8c36f57014 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments/6b75e0ee-7c1d-47a1-be38-c05dc84b7df9" status: 200 len: 194 microversion: 2.1 time: 0.050414 Oct 27 09:42:56.451017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 461/917] 10.222.0.70 () {58 vars in 1413 bytes} [Thu Oct 27 09:42:56 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments/6b75e0ee-7c1d-47a1-be38-c05dc84b7df9 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:42:56.949532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:56.950244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:56.957426 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.958156 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.958792 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.959496 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:56.960110 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:56.960735 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:56.984284 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:42:57.135389 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:57.147107 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:57.150439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:57.153187 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8854f6c3-b3ba-4b4a-8ae1-8dded730b69a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1736 microversion: 2.20 time: 0.209086 Oct 27 09:42:57.154266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 457/918] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:56 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:57.413766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f6fbd27b-558e-4365-84e5-b83bd73568c5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:57.415969 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f6fbd27b-558e-4365-84e5-b83bd73568c5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:57.425515 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6fbd27b-558e-4365-84e5-b83bd73568c5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.425994 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6fbd27b-558e-4365-84e5-b83bd73568c5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.426434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6fbd27b-558e-4365-84e5-b83bd73568c5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.427144 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6fbd27b-558e-4365-84e5-b83bd73568c5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.427592 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6fbd27b-558e-4365-84e5-b83bd73568c5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.428015 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6fbd27b-558e-4365-84e5-b83bd73568c5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.465190 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f6fbd27b-558e-4365-84e5-b83bd73568c5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063290 Oct 27 09:42:57.466808 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 462/919] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:42:57 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:42:57.545776 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fde06b0d-3b56-4d9f-8d02-a962996d8664 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:57.546224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fde06b0d-3b56-4d9f-8d02-a962996d8664 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:57.555160 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fde06b0d-3b56-4d9f-8d02-a962996d8664 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.555687 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fde06b0d-3b56-4d9f-8d02-a962996d8664 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.556309 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fde06b0d-3b56-4d9f-8d02-a962996d8664 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.557217 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fde06b0d-3b56-4d9f-8d02-a962996d8664 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.557831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fde06b0d-3b56-4d9f-8d02-a962996d8664 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.558418 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fde06b0d-3b56-4d9f-8d02-a962996d8664 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.592239 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fde06b0d-3b56-4d9f-8d02-a962996d8664 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:42:57.710276 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fde06b0d-3b56-4d9f-8d02-a962996d8664 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 204 len: 0 microversion: 2.1 time: 0.168736 Oct 27 09:42:57.711520 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 458/920] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:42:57 2022] DELETE /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:42:57.722215 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3c07e200-1350-47e0-928c-aa041fa62b17 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:57.722829 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3c07e200-1350-47e0-928c-aa041fa62b17 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:57.728953 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3c07e200-1350-47e0-928c-aa041fa62b17 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.729755 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3c07e200-1350-47e0-928c-aa041fa62b17 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.730306 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3c07e200-1350-47e0-928c-aa041fa62b17 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.731247 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3c07e200-1350-47e0-928c-aa041fa62b17 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.732460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3c07e200-1350-47e0-928c-aa041fa62b17 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.732998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3c07e200-1350-47e0-928c-aa041fa62b17 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.946093 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-27b39613-b43e-4beb-bc10-d12537d84d37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed988fcd-b18a-4a19-9ca5-9d9451a5f512"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:42:57.949760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-27b39613-b43e-4beb-bc10-d12537d84d37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:57.962363 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3c07e200-1350-47e0-928c-aa041fa62b17 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:57.962853 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27b39613-b43e-4beb-bc10-d12537d84d37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.963530 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27b39613-b43e-4beb-bc10-d12537d84d37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.964133 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27b39613-b43e-4beb-bc10-d12537d84d37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.965025 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27b39613-b43e-4beb-bc10-d12537d84d37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:57.965631 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27b39613-b43e-4beb-bc10-d12537d84d37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:57.966209 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27b39613-b43e-4beb-bc10-d12537d84d37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:57.970843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3c07e200-1350-47e0-928c-aa041fa62b17 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1683 microversion: 2.1 time: 0.254024 Oct 27 09:42:57.971410 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 463/921] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:57 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1683 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:58.184416 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:58.185294 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:58.191651 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:58.192205 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:58.192888 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:58.193807 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:58.194461 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:58.195091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:58.386804 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:58.395616 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:58.397308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:58.398743 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-68b71b2e-6dd9-45fa-b654-16a62e4fbadb tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1736 microversion: 2.20 time: 0.220374 Oct 27 09:42:58.400844 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 464/922] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:58 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:42:59.002085 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-11aa1fae-3297-4ddc-8e61-9913c662c749 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:59.002727 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-11aa1fae-3297-4ddc-8e61-9913c662c749 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:59.017419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-11aa1fae-3297-4ddc-8e61-9913c662c749 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:59.018228 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-11aa1fae-3297-4ddc-8e61-9913c662c749 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:59.018837 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-11aa1fae-3297-4ddc-8e61-9913c662c749 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:59.019717 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-11aa1fae-3297-4ddc-8e61-9913c662c749 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:59.020342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-11aa1fae-3297-4ddc-8e61-9913c662c749 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:59.021079 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-11aa1fae-3297-4ddc-8e61-9913c662c749 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:59.195369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-11aa1fae-3297-4ddc-8e61-9913c662c749 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:59.205789 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-11aa1fae-3297-4ddc-8e61-9913c662c749 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1683 microversion: 2.1 time: 0.208139 Oct 27 09:42:59.210608 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 465/923] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:42:58 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1683 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:42:59.366273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-27b39613-b43e-4beb-bc10-d12537d84d37 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "POST /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.424399 Oct 27 09:42:59.369402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 459/924] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:42:57 2022] POST /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments => generated 194 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:42:59.425419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:42:59.426030 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:42:59.466314 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:59.468322 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:59.469756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:59.470635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:42:59.471250 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:42:59.472367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:42:59.774097 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:59.790186 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:59.791628 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:42:59.793067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9d720a88-ee43-4473-85f4-4ff70aab5fd2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1736 microversion: 2.20 time: 0.371523 Oct 27 09:42:59.804998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 466/925] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:42:59 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1736 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:00.240509 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-126bd9c7-f685-4504-86ef-289c5a3cdea5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:00.241687 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-126bd9c7-f685-4504-86ef-289c5a3cdea5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:00.252563 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-126bd9c7-f685-4504-86ef-289c5a3cdea5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:00.257665 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-126bd9c7-f685-4504-86ef-289c5a3cdea5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:00.258356 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-126bd9c7-f685-4504-86ef-289c5a3cdea5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:00.259823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-126bd9c7-f685-4504-86ef-289c5a3cdea5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:00.260441 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-126bd9c7-f685-4504-86ef-289c5a3cdea5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:00.261046 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-126bd9c7-f685-4504-86ef-289c5a3cdea5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:00.484291 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-126bd9c7-f685-4504-86ef-289c5a3cdea5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:00.492215 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-126bd9c7-f685-4504-86ef-289c5a3cdea5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1683 microversion: 2.1 time: 0.256490 Oct 27 09:43:00.500564 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 460/926] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:00 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1683 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:00.823273 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:00.830019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:00.841673 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:00.843198 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:00.843966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:00.845248 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:00.846720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:00.847413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:00.976607 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-5be00f14-6d3f-4866-9c1a-c7095774f78d req-8172d7f7-78f1-4f1f-b93a-691dd85fb5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d59eaa9a-23ee-4664-bea0-d16de93dfa7f", "name": "network-vif-deleted", "tag": "f156fae7-f5fd-48a7-ba37-040eb64d86ae"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:00.991487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5be00f14-6d3f-4866-9c1a-c7095774f78d req-8172d7f7-78f1-4f1f-b93a-691dd85fb5bd service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:00.992104 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5be00f14-6d3f-4866-9c1a-c7095774f78d req-8172d7f7-78f1-4f1f-b93a-691dd85fb5bd service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:01.001090 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-5be00f14-6d3f-4866-9c1a-c7095774f78d req-8172d7f7-78f1-4f1f-b93a-691dd85fb5bd service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:01.040716 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-5be00f14-6d3f-4866-9c1a-c7095774f78d req-8172d7f7-78f1-4f1f-b93a-691dd85fb5bd service nova] Creating event network-vif-deleted:f156fae7-f5fd-48a7-ba37-040eb64d86ae for instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f on hv-cinder-79797 Oct 27 09:43:01.049479 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-5be00f14-6d3f-4866-9c1a-c7095774f78d req-8172d7f7-78f1-4f1f-b93a-691dd85fb5bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081562 Oct 27 09:43:01.050333 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 461/927] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:01.064979 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:01.080679 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:01.082136 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:01.089438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2d2661ee-4e53-4a4e-b14c-918e7a887dbe tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1736 microversion: 2.20 time: 0.273377 Oct 27 09:43:01.091479 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 467/928] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:00 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1736 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:01.524640 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:01.525431 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:01.541789 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:01.542312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:01.543054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:01.543763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:01.544616 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:01.545240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:01.589306 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:01.589794 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:01.590411 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:01.591139 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lazy-loading 'fault' on Instance uuid d59eaa9a-23ee-4664-bea0-d16de93dfa7f {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:01.645050 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:01.654007 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-05ec6e1c-eb17-40a5-b3af-5cf6b2185848 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 200 len: 1332 microversion: 2.1 time: 0.134058 Oct 27 09:43:01.654731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 462/929] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:01 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:02.117192 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:02.117952 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:02.127204 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:02.127677 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:02.128116 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:02.128837 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:02.129286 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:02.129700 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:02.263544 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:02.272052 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:02.273545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:02.275227 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cabe40cb-221c-485b-afa2-1d452e618cf8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1718 microversion: 2.20 time: 0.162006 Oct 27 09:43:02.275792 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 468/930] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:02 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:43:02.677580 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:02.678129 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:02.684598 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:02.685084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:02.685518 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:02.686210 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:02.686662 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:02.687084 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:02.701477 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f HTTP/1.1 Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:43:02.703092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:43:02.704657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': 'd59eaa9a-23ee-4664-bea0-d16de93dfa7f'} Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:43:02.705573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:43:02.707049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:02.708491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:43:02.708491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ca5b042a-216d-47c8-a55d-34265df5014b tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 404 len: 111 microversion: 2.1 time: 0.030860 Oct 27 09:43:02.708491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 463/931] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:02 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:43:02.713657 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-dc9e86a0-37d3-4415-96b9-0e5dbccbc3bf tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '.version_select at 0x7f3649188430>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:02.731365 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-dc9e86a0-37d3-4415-96b9-0e5dbccbc3bf tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322837854" status: 202 len: 0 microversion: 2.1 time: 0.022000 Oct 27 09:43:02.731912 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 469/932] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Oct 27 09:43:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322837854 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:43:03.302889 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:03.303587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:03.310905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:03.311398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:03.311838 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:03.313214 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:03.313361 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:03.317071 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:03.322765 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4ee2da0e-a4d6-477a-89ee-87972d8e4122 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: .version_select at 0x7f36492635e0>, body: {"keypair": {"name": "tempest-keypair-834887002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILbzZTtbmXdpEMRGfpu37sGcCCrdaqteToePfLK389ufNtsZinzQTy+5jveoGt4ZT74mfDnQNvGiuk3B+j2aaqRKM73lnZYrkPKORM9fDj6u2s+pLtxR4YVCuMd5PxfZA=="}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:03.339153 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-4ee2da0e-a4d6-477a-89ee-87972d8e4122 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:43:03.342998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-4ee2da0e-a4d6-477a-89ee-87972d8e4122 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for user f7d2c6275669404db608d714baeb0065 and project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'key_pairs'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:43:03.365422 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4ee2da0e-a4d6-477a-89ee-87972d8e4122 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046383 Oct 27 09:43:03.366030 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 470/933] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Oct 27 09:43:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:43:03.454025 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:03.462261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:03.463710 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:03.464902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-cfbd5d35-5510-425b-bf00-d16b3730a462 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1718 microversion: 2.20 time: 0.167044 Oct 27 09:43:03.477535 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 464/934] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:03 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1718 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:04.494093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:04.494878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:04.501374 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:04.501791 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:04.502230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:04.503703 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:04.504167 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:04.504630 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:04.657869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:04.667450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:04.669040 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:04.670222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d8597748-2da8-48ed-9f98-339847620114 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1718 microversion: 2.20 time: 0.181441 Oct 27 09:43:04.670777 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 471/935] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:04 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1718 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:04.678017 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-696008314", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15104d09-0e0f-4140-ae39-9239f083d338"}], "security_groups": [{"name": "tempest-securitygroup--1094295401"}], "key_name": "tempest-keypair-834887002", "user_data": "}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:04.780842 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] validate_networks() for [('15104d09-0e0f-4140-ae39-9239f083d338', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:43:05.232325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:43:05.232778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:43:05.233254 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:43:05.233661 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:43:05.234071 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:43:05.243314 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:05.243795 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:05.244228 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:05.244999 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:05.245454 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:05.245880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:05.262735 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:43:05.266657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Getting quotas for user f7d2c6275669404db608d714baeb0065 and project df84eaa566a24d3e8d25c1065e8c09fa. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:43:05.277630 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:43:05.279850 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:43:05.326652 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f4b53ea5-28e6-4873-8a57-bcdae211c5aa tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.652893 Oct 27 09:43:05.327301 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 465/936] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:43:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:43:05.338414 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4a04ac6b-a94f-4ded-aff4-3b3f991f00da tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:05.339115 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4a04ac6b-a94f-4ded-aff4-3b3f991f00da tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:05.396584 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4a04ac6b-a94f-4ded-aff4-3b3f991f00da tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:05.403596 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4a04ac6b-a94f-4ded-aff4-3b3f991f00da tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1240 microversion: 2.1 time: 0.069090 Oct 27 09:43:05.404290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 472/937] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:05 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:05.695643 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:05.696831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:05.708339 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:05.709798 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:05.710503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:05.712237 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:05.713052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:05.714320 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:05.724744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-cb02a159-81a1-421b-a06e-6ef0f42a7209 req-c13cee24-3eb6-4826-8711-a570f383a3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a898b1b-5c82-41b1-8b68-0ad30a3516a1", "name": "network-vif-unplugged", "status": "completed", "tag": "c4193921-efc0-4d0e-8a62-50ecf8de25b1"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:05.739266 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-cb02a159-81a1-421b-a06e-6ef0f42a7209 req-c13cee24-3eb6-4826-8711-a570f383a3aa service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:05.740575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-cb02a159-81a1-421b-a06e-6ef0f42a7209 req-c13cee24-3eb6-4826-8711-a570f383a3aa service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:05.741294 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-cb02a159-81a1-421b-a06e-6ef0f42a7209 req-c13cee24-3eb6-4826-8711-a570f383a3aa service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:05.761184 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-cb02a159-81a1-421b-a06e-6ef0f42a7209 req-c13cee24-3eb6-4826-8711-a570f383a3aa service nova] Creating event network-vif-unplugged:c4193921-efc0-4d0e-8a62-50ecf8de25b1 for instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 on hv-cinder-79797 Oct 27 09:43:05.766698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-cb02a159-81a1-421b-a06e-6ef0f42a7209 req-c13cee24-3eb6-4826-8711-a570f383a3aa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046279 Oct 27 09:43:05.767542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 473/938] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:43:05.922277 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:05.930545 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:05.931988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:05.933166 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d45b78a8-b096-4b81-be60-405abd786645 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1718 microversion: 2.20 time: 0.241455 Oct 27 09:43:05.933703 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 466/939] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:05 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1718 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:06.572640 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3e127a84-332c-403f-9a0b-bf43b17d1f33 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:06.573348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3e127a84-332c-403f-9a0b-bf43b17d1f33 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:06.579706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3e127a84-332c-403f-9a0b-bf43b17d1f33 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:06.580185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3e127a84-332c-403f-9a0b-bf43b17d1f33 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:06.580648 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3e127a84-332c-403f-9a0b-bf43b17d1f33 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:06.581345 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3e127a84-332c-403f-9a0b-bf43b17d1f33 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:06.581803 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3e127a84-332c-403f-9a0b-bf43b17d1f33 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:06.582227 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3e127a84-332c-403f-9a0b-bf43b17d1f33 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:06.643728 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3e127a84-332c-403f-9a0b-bf43b17d1f33 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:06.651329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3e127a84-332c-403f-9a0b-bf43b17d1f33 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1236 microversion: 2.1 time: 0.228550 Oct 27 09:43:06.651896 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 474/940] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:06 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1236 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:06.963763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:06.964653 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:06.971547 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:06.971928 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:06.972367 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:06.973169 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:06.973626 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:06.974043 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.034265 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e9366bd5-6d38-4b7e-9a9b-51796e2098a9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:07.036404 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e9366bd5-6d38-4b7e-9a9b-51796e2098a9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:07.043339 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e9366bd5-6d38-4b7e-9a9b-51796e2098a9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.043822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e9366bd5-6d38-4b7e-9a9b-51796e2098a9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.044252 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e9366bd5-6d38-4b7e-9a9b-51796e2098a9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.044971 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e9366bd5-6d38-4b7e-9a9b-51796e2098a9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.045424 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e9366bd5-6d38-4b7e-9a9b-51796e2098a9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.046030 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e9366bd5-6d38-4b7e-9a9b-51796e2098a9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.078062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e9366bd5-6d38-4b7e-9a9b-51796e2098a9 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047617 Oct 27 09:43:07.078726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 475/941] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:43:07 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:43:07.111406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:07.120044 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:07.121629 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:07.122794 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e79d2b58-e0fa-4d1f-bf22-f8cce1e606af tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1661 microversion: 2.20 time: 0.163195 Oct 27 09:43:07.123356 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 467/942] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:06 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1661 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:07.147486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5b9ec774-34b0-4c78-bf0c-cb367e7f3e4a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f997d8c8-2d7e-4c75-8f45-a07aa261a2c2"}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:07.149833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5b9ec774-34b0-4c78-bf0c-cb367e7f3e4a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:07.155720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b9ec774-34b0-4c78-bf0c-cb367e7f3e4a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.156233 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b9ec774-34b0-4c78-bf0c-cb367e7f3e4a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.156732 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b9ec774-34b0-4c78-bf0c-cb367e7f3e4a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.157518 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b9ec774-34b0-4c78-bf0c-cb367e7f3e4a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.157969 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b9ec774-34b0-4c78-bf0c-cb367e7f3e4a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.158398 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5b9ec774-34b0-4c78-bf0c-cb367e7f3e4a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.225479 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c3ab5594-a60d-490d-bbbb-5fe4334e95bd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:07.226202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c3ab5594-a60d-490d-bbbb-5fe4334e95bd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:07.233055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c3ab5594-a60d-490d-bbbb-5fe4334e95bd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.233546 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c3ab5594-a60d-490d-bbbb-5fe4334e95bd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.233978 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c3ab5594-a60d-490d-bbbb-5fe4334e95bd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.234847 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c3ab5594-a60d-490d-bbbb-5fe4334e95bd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.235471 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c3ab5594-a60d-490d-bbbb-5fe4334e95bd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.236073 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c3ab5594-a60d-490d-bbbb-5fe4334e95bd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.270902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c3ab5594-a60d-490d-bbbb-5fe4334e95bd tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments/6b75e0ee-7c1d-47a1-be38-c05dc84b7df9" status: 200 len: 194 microversion: 2.1 time: 0.049233 Oct 27 09:43:07.278680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 468/943] 10.222.0.70 () {58 vars in 1413 bytes} [Thu Oct 27 09:43:07 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments/6b75e0ee-7c1d-47a1-be38-c05dc84b7df9 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:43:07.284158 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0948ad53-5a25-4dfd-8543-ada5212c2678 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:07.284912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0948ad53-5a25-4dfd-8543-ada5212c2678 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:07.292717 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0948ad53-5a25-4dfd-8543-ada5212c2678 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.293300 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0948ad53-5a25-4dfd-8543-ada5212c2678 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.294058 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0948ad53-5a25-4dfd-8543-ada5212c2678 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.294726 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0948ad53-5a25-4dfd-8543-ada5212c2678 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.295340 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0948ad53-5a25-4dfd-8543-ada5212c2678 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.295949 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0948ad53-5a25-4dfd-8543-ada5212c2678 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.416948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-0948ad53-5a25-4dfd-8543-ada5212c2678 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'services' on Instance uuid cacbe115-560c-4934-acc5-ca08bcac81c7 {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:07.549283 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5b9ec774-34b0-4c78-bf0c-cb367e7f3e4a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "POST /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.405658 Oct 27 09:43:07.557378 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 476/944] 10.222.0.70 () {62 vars in 1364 bytes} [Thu Oct 27 09:43:07 2022] POST /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/os-volume_attachments => generated 188 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 09:43:07.570835 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0948ad53-5a25-4dfd-8543-ada5212c2678 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments/6b75e0ee-7c1d-47a1-be38-c05dc84b7df9" status: 202 len: 0 microversion: 2.1 time: 0.290624 Oct 27 09:43:07.571670 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 469/945] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:43:07 2022] DELETE /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments/6b75e0ee-7c1d-47a1-be38-c05dc84b7df9 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:43:07.686119 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-66ac2d38-4a6a-43bf-aa33-0f376014f8b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:07.690275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-66ac2d38-4a6a-43bf-aa33-0f376014f8b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:07.702554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-66ac2d38-4a6a-43bf-aa33-0f376014f8b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.703231 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-66ac2d38-4a6a-43bf-aa33-0f376014f8b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.706713 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b968137a-eaf7-4c78-bab3-dda58763f779 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:07.707528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b968137a-eaf7-4c78-bab3-dda58763f779 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:07.710904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-66ac2d38-4a6a-43bf-aa33-0f376014f8b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.712820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-66ac2d38-4a6a-43bf-aa33-0f376014f8b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.713437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-66ac2d38-4a6a-43bf-aa33-0f376014f8b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.714020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-66ac2d38-4a6a-43bf-aa33-0f376014f8b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.722152 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b968137a-eaf7-4c78-bab3-dda58763f779 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.722670 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b968137a-eaf7-4c78-bab3-dda58763f779 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.723281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b968137a-eaf7-4c78-bab3-dda58763f779 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.724346 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b968137a-eaf7-4c78-bab3-dda58763f779 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:07.724468 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b968137a-eaf7-4c78-bab3-dda58763f779 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:07.724947 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b968137a-eaf7-4c78-bab3-dda58763f779 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:07.793911 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-66ac2d38-4a6a-43bf-aa33-0f376014f8b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:07.805030 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-66ac2d38-4a6a-43bf-aa33-0f376014f8b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1298 microversion: 2.1 time: 0.133310 Oct 27 09:43:07.805979 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 477/946] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:07 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1298 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:07.842516 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:07.982287 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b968137a-eaf7-4c78-bab3-dda58763f779 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/os-volume_attachments/f997d8c8-2d7e-4c75-8f45-a07aa261a2c2" status: 202 len: 0 microversion: 2.20 time: 0.282289 Oct 27 09:43:07.983345 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 470/947] 10.222.0.70 () {60 vars in 1457 bytes} [Thu Oct 27 09:43:07 2022] DELETE /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/os-volume_attachments/f997d8c8-2d7e-4c75-8f45-a07aa261a2c2 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:43:08.055576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-67e157f3-c5b3-44f4-b90c-4fe8e1431b77 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:08.056200 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-67e157f3-c5b3-44f4-b90c-4fe8e1431b77 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:08.063705 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67e157f3-c5b3-44f4-b90c-4fe8e1431b77 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.064452 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67e157f3-c5b3-44f4-b90c-4fe8e1431b77 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.065284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67e157f3-c5b3-44f4-b90c-4fe8e1431b77 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.066300 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67e157f3-c5b3-44f4-b90c-4fe8e1431b77 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.066926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67e157f3-c5b3-44f4-b90c-4fe8e1431b77 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.067517 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-67e157f3-c5b3-44f4-b90c-4fe8e1431b77 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.105879 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-67e157f3-c5b3-44f4-b90c-4fe8e1431b77 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125361) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 09:43:08.147049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:08.179016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-67e157f3-c5b3-44f4-b90c-4fe8e1431b77 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "POST /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/action" status: 202 len: 0 microversion: 2.20 time: 0.127791 Oct 27 09:43:08.180507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 478/948] 10.222.0.70 () {62 vars in 1319 bytes} [Thu Oct 27 09:43:08 2022] POST /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:43:08.188954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:08.189823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:08.198116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.199497 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.200111 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.201175 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.201787 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.203791 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.482059 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:08.490449 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:08.491858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:08.493693 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9c2ce245-4a46-4904-9793-6444a0bf62b4 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1669 microversion: 2.20 time: 0.309074 Oct 27 09:43:08.494271 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 471/949] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:08 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1669 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:08.733678 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c5bbbe81-7428-4158-92f4-455e1c70741d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:08.734401 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c5bbbe81-7428-4158-92f4-455e1c70741d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:08.740943 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5bbbe81-7428-4158-92f4-455e1c70741d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.741935 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5bbbe81-7428-4158-92f4-455e1c70741d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.743042 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5bbbe81-7428-4158-92f4-455e1c70741d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.744335 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5bbbe81-7428-4158-92f4-455e1c70741d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.745076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5bbbe81-7428-4158-92f4-455e1c70741d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.745760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c5bbbe81-7428-4158-92f4-455e1c70741d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.784057 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c5bbbe81-7428-4158-92f4-455e1c70741d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments/ed988fcd-b18a-4a19-9ca5-9d9451a5f512" status: 200 len: 194 microversion: 2.1 time: 0.054791 Oct 27 09:43:08.785024 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 479/950] 10.222.0.70 () {58 vars in 1413 bytes} [Thu Oct 27 09:43:08 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments/ed988fcd-b18a-4a19-9ca5-9d9451a5f512 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:08.796933 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1fcec32c-fe21-434a-bcff-035d41f96581 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:08.797713 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1fcec32c-fe21-434a-bcff-035d41f96581 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:08.804688 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1fcec32c-fe21-434a-bcff-035d41f96581 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.806052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1fcec32c-fe21-434a-bcff-035d41f96581 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.806705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1fcec32c-fe21-434a-bcff-035d41f96581 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.807584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1fcec32c-fe21-434a-bcff-035d41f96581 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.808034 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1fcec32c-fe21-434a-bcff-035d41f96581 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.808657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1fcec32c-fe21-434a-bcff-035d41f96581 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.829772 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c0c8f6e4-c94e-49b6-b7e9-6f98bf5fefa1 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:08.830460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c0c8f6e4-c94e-49b6-b7e9-6f98bf5fefa1 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:08.839488 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0c8f6e4-c94e-49b6-b7e9-6f98bf5fefa1 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.839973 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0c8f6e4-c94e-49b6-b7e9-6f98bf5fefa1 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.840731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0c8f6e4-c94e-49b6-b7e9-6f98bf5fefa1 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.843480 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0c8f6e4-c94e-49b6-b7e9-6f98bf5fefa1 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:08.844339 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0c8f6e4-c94e-49b6-b7e9-6f98bf5fefa1 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:08.845035 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0c8f6e4-c94e-49b6-b7e9-6f98bf5fefa1 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:08.923175 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-1fcec32c-fe21-434a-bcff-035d41f96581 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'services' on Instance uuid cacbe115-560c-4934-acc5-ca08bcac81c7 {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:09.041079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1fcec32c-fe21-434a-bcff-035d41f96581 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments/ed988fcd-b18a-4a19-9ca5-9d9451a5f512" status: 202 len: 0 microversion: 2.1 time: 0.247479 Oct 27 09:43:09.042918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 472/951] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:43:08 2022] DELETE /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments/ed988fcd-b18a-4a19-9ca5-9d9451a5f512 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:43:09.173144 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c0c8f6e4-c94e-49b6-b7e9-6f98bf5fefa1 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:09.182356 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c0c8f6e4-c94e-49b6-b7e9-6f98bf5fefa1 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.355983 Oct 27 09:43:09.183280 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 480/952] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:08 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:09.469301 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-da2d7b0c-e136-4f24-8954-69716cc422c1 req-559e48f6-7ff7-4226-8514-5b0a0449c46e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6d582c-7b11-474d-ade0-762c6ccee705", "tag": "345288e1-68e9-44e4-b75d-e117a08b1f49"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:09.486173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-da2d7b0c-e136-4f24-8954-69716cc422c1 req-559e48f6-7ff7-4226-8514-5b0a0449c46e service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:09.486653 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-da2d7b0c-e136-4f24-8954-69716cc422c1 req-559e48f6-7ff7-4226-8514-5b0a0449c46e service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:09.487468 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-da2d7b0c-e136-4f24-8954-69716cc422c1 req-559e48f6-7ff7-4226-8514-5b0a0449c46e service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:09.501561 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-da2d7b0c-e136-4f24-8954-69716cc422c1 req-559e48f6-7ff7-4226-8514-5b0a0449c46e service nova] Creating event network-changed:345288e1-68e9-44e4-b75d-e117a08b1f49 for instance fc6d582c-7b11-474d-ade0-762c6ccee705 on hv-cinder-79797 Oct 27 09:43:09.508548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-da2d7b0c-e136-4f24-8954-69716cc422c1 req-559e48f6-7ff7-4226-8514-5b0a0449c46e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045740 Oct 27 09:43:09.509965 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 473/953] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:09.518824 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:09.519459 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:09.525615 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:09.526086 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:09.526813 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:09.527491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:09.527940 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:09.528355 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:09.740295 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:09.752926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:09.755172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:09.757779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ca8eb3d6-1083-4552-9207-64b5a3c65821 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.242077 Oct 27 09:43:09.759213 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 481/954] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:09 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:10.225179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-87c714f5-76e2-42c6-a6ac-283575b1bc97 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:10.227135 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-87c714f5-76e2-42c6-a6ac-283575b1bc97 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:10.238997 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87c714f5-76e2-42c6-a6ac-283575b1bc97 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.239690 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87c714f5-76e2-42c6-a6ac-283575b1bc97 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.240313 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87c714f5-76e2-42c6-a6ac-283575b1bc97 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.241693 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87c714f5-76e2-42c6-a6ac-283575b1bc97 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.242331 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87c714f5-76e2-42c6-a6ac-283575b1bc97 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.242763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-87c714f5-76e2-42c6-a6ac-283575b1bc97 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.259618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-bcb543cb-e444-477b-a3fd-2373b23e4a0a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:10.262640 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-bcb543cb-e444-477b-a3fd-2373b23e4a0a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:10.269872 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bcb543cb-e444-477b-a3fd-2373b23e4a0a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.270554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bcb543cb-e444-477b-a3fd-2373b23e4a0a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.271157 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bcb543cb-e444-477b-a3fd-2373b23e4a0a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.272022 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bcb543cb-e444-477b-a3fd-2373b23e4a0a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.272778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bcb543cb-e444-477b-a3fd-2373b23e4a0a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.273371 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bcb543cb-e444-477b-a3fd-2373b23e4a0a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.308307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-bcb543cb-e444-477b-a3fd-2373b23e4a0a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053283 Oct 27 09:43:10.308911 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 482/955] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:43:10 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:43:10.438012 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5ca8c10f-8804-40ef-a7ec-94224e18897d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:10.440573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5ca8c10f-8804-40ef-a7ec-94224e18897d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:10.447429 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ca8c10f-8804-40ef-a7ec-94224e18897d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.447916 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ca8c10f-8804-40ef-a7ec-94224e18897d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.448351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ca8c10f-8804-40ef-a7ec-94224e18897d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.449328 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ca8c10f-8804-40ef-a7ec-94224e18897d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.449951 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ca8c10f-8804-40ef-a7ec-94224e18897d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.450372 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5ca8c10f-8804-40ef-a7ec-94224e18897d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.481754 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5ca8c10f-8804-40ef-a7ec-94224e18897d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047525 Oct 27 09:43:10.482320 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 483/956] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:43:10 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 09:43:10.551000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8763c608-2421-4a55-9cbf-9b63d294595e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:10.551495 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8763c608-2421-4a55-9cbf-9b63d294595e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:10.557928 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8763c608-2421-4a55-9cbf-9b63d294595e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.558404 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8763c608-2421-4a55-9cbf-9b63d294595e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.558832 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8763c608-2421-4a55-9cbf-9b63d294595e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.559517 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8763c608-2421-4a55-9cbf-9b63d294595e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.559964 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8763c608-2421-4a55-9cbf-9b63d294595e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.560383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8763c608-2421-4a55-9cbf-9b63d294595e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.586580 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8763c608-2421-4a55-9cbf-9b63d294595e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Going to try to terminate instance {{(pid=125361) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:43:10.634699 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-87c714f5-76e2-42c6-a6ac-283575b1bc97 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:10.648473 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-87c714f5-76e2-42c6-a6ac-283575b1bc97 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.444209 Oct 27 09:43:10.651824 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 474/957] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:10 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:10.676363 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8763c608-2421-4a55-9cbf-9b63d294595e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 204 len: 0 microversion: 2.1 time: 0.128345 Oct 27 09:43:10.681730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 484/958] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:43:10 2022] DELETE /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:43:10.688711 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a4ecad90-2846-4f8b-911b-a96016448c6d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:10.689433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a4ecad90-2846-4f8b-911b-a96016448c6d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:10.703000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4ecad90-2846-4f8b-911b-a96016448c6d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.705828 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4ecad90-2846-4f8b-911b-a96016448c6d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.706377 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4ecad90-2846-4f8b-911b-a96016448c6d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.707719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4ecad90-2846-4f8b-911b-a96016448c6d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.708278 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4ecad90-2846-4f8b-911b-a96016448c6d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.708867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a4ecad90-2846-4f8b-911b-a96016448c6d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.785977 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:10.786677 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:10.793172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.793659 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.794094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.794792 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:10.795292 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:10.795811 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:10.857744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a4ecad90-2846-4f8b-911b-a96016448c6d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:10.866029 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a4ecad90-2846-4f8b-911b-a96016448c6d tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1673 microversion: 2.1 time: 0.182269 Oct 27 09:43:10.866611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 475/959] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:10 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:10.952999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:10.961864 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:10.963629 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:10.964880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ab22a08a-9dfb-4844-bfd9-f31715043f07 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.183011 Oct 27 09:43:10.965439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 485/960] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:10 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:43:11.674571 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f35f8ddf-1a40-4fab-8be3-d4efdd41eca7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:11.675187 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f35f8ddf-1a40-4fab-8be3-d4efdd41eca7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:11.682305 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f35f8ddf-1a40-4fab-8be3-d4efdd41eca7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:11.682774 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f35f8ddf-1a40-4fab-8be3-d4efdd41eca7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:11.683210 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f35f8ddf-1a40-4fab-8be3-d4efdd41eca7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:11.683902 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f35f8ddf-1a40-4fab-8be3-d4efdd41eca7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:11.684356 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f35f8ddf-1a40-4fab-8be3-d4efdd41eca7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:11.684810 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f35f8ddf-1a40-4fab-8be3-d4efdd41eca7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:11.821471 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f35f8ddf-1a40-4fab-8be3-d4efdd41eca7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:11.829614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f35f8ddf-1a40-4fab-8be3-d4efdd41eca7 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.159023 Oct 27 09:43:11.830209 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 476/961] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:11 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:11.890079 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cabb6808-2f8f-4702-b2b1-1c61bb482f47 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:11.890690 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cabb6808-2f8f-4702-b2b1-1c61bb482f47 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:11.897324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabb6808-2f8f-4702-b2b1-1c61bb482f47 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:11.898021 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabb6808-2f8f-4702-b2b1-1c61bb482f47 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:11.898445 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabb6808-2f8f-4702-b2b1-1c61bb482f47 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:11.899726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabb6808-2f8f-4702-b2b1-1c61bb482f47 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:11.900090 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabb6808-2f8f-4702-b2b1-1c61bb482f47 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:11.900533 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cabb6808-2f8f-4702-b2b1-1c61bb482f47 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:11.993037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:11.993739 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:11.999611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:12.000099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:12.000555 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:12.001251 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:12.001707 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:12.002136 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:12.034238 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cabb6808-2f8f-4702-b2b1-1c61bb482f47 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:12.042924 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cabb6808-2f8f-4702-b2b1-1c61bb482f47 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1673 microversion: 2.1 time: 0.156670 Oct 27 09:43:12.043507 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 486/962] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:11 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:12.143611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:12.151996 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:12.153674 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:12.154843 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0d7191c7-c435-47bb-bdf0-aa8d88de75a8 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.165642 Oct 27 09:43:12.155400 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 477/963] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:11 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:43:12.853766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8b5f02b7-1681-47aa-a782-9f3a91dbeef5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:12.854643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8b5f02b7-1681-47aa-a782-9f3a91dbeef5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:12.858180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:12.862218 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8b5f02b7-1681-47aa-a782-9f3a91dbeef5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:12.862714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8b5f02b7-1681-47aa-a782-9f3a91dbeef5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:12.863154 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8b5f02b7-1681-47aa-a782-9f3a91dbeef5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:12.863858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8b5f02b7-1681-47aa-a782-9f3a91dbeef5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:12.864316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8b5f02b7-1681-47aa-a782-9f3a91dbeef5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:12.864812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8b5f02b7-1681-47aa-a782-9f3a91dbeef5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:12.999254 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-8b5f02b7-1681-47aa-a782-9f3a91dbeef5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:13.006812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8b5f02b7-1681-47aa-a782-9f3a91dbeef5 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.157752 Oct 27 09:43:13.007380 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 487/964] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:12 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:13.066948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-06271d92-46ce-4965-9e91-a52da96c90a6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:13.067608 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-06271d92-46ce-4965-9e91-a52da96c90a6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:13.074728 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-06271d92-46ce-4965-9e91-a52da96c90a6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:13.075225 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-06271d92-46ce-4965-9e91-a52da96c90a6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:13.075885 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-06271d92-46ce-4965-9e91-a52da96c90a6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:13.076650 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-06271d92-46ce-4965-9e91-a52da96c90a6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:13.077108 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-06271d92-46ce-4965-9e91-a52da96c90a6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:13.077538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-06271d92-46ce-4965-9e91-a52da96c90a6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:13.181766 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:13.182387 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:13.188451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:13.189179 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:13.189639 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:13.190344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:13.190793 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:13.191243 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:13.290982 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-06271d92-46ce-4965-9e91-a52da96c90a6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:13.299398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-06271d92-46ce-4965-9e91-a52da96c90a6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1673 microversion: 2.1 time: 0.236231 Oct 27 09:43:13.300245 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 478/965] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:13 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1673 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:13.443048 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:13.453558 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:13.455135 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:13.456492 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6054d0af-3d2c-44cc-ab50-6dbd3fb6e4e5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.279433 Oct 27 09:43:13.457081 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 488/966] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:13 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:43:14.030512 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-40c6fad7-c28f-4210-998b-7cca692460b2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:14.031533 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-40c6fad7-c28f-4210-998b-7cca692460b2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:14.039116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40c6fad7-c28f-4210-998b-7cca692460b2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:14.040159 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40c6fad7-c28f-4210-998b-7cca692460b2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:14.040612 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40c6fad7-c28f-4210-998b-7cca692460b2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:14.041325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40c6fad7-c28f-4210-998b-7cca692460b2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:14.041784 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40c6fad7-c28f-4210-998b-7cca692460b2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:14.042278 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-40c6fad7-c28f-4210-998b-7cca692460b2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:14.210243 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-40c6fad7-c28f-4210-998b-7cca692460b2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:14.221736 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-40c6fad7-c28f-4210-998b-7cca692460b2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.195445 Oct 27 09:43:14.229756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 479/967] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:14 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:14.325153 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-dbab6184-1f44-4350-8e6b-4f73703fc6fc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:14.331607 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-dbab6184-1f44-4350-8e6b-4f73703fc6fc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:14.354601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dbab6184-1f44-4350-8e6b-4f73703fc6fc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:14.356293 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dbab6184-1f44-4350-8e6b-4f73703fc6fc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:14.357356 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dbab6184-1f44-4350-8e6b-4f73703fc6fc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:14.361052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dbab6184-1f44-4350-8e6b-4f73703fc6fc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:14.362969 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dbab6184-1f44-4350-8e6b-4f73703fc6fc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:14.364188 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-dbab6184-1f44-4350-8e6b-4f73703fc6fc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:14.560500 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-dbab6184-1f44-4350-8e6b-4f73703fc6fc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:14.575900 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-dbab6184-1f44-4350-8e6b-4f73703fc6fc tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1322 microversion: 2.1 time: 0.252984 Oct 27 09:43:14.578175 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 480/968] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:14 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:14.594078 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:14.596389 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:14.614473 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:14.622028 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:14.623877 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:14.626725 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:14.627412 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:14.628013 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:14.642835 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-42db33e9-7e21-4fa6-8ef9-dc459ddc977d req-b3ddddd4-4249-4a4b-a77f-ec5480198d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cacbe115-560c-4934-acc5-ca08bcac81c7", "name": "network-vif-deleted", "tag": "de6ac140-1998-47ee-b791-3c7089ad7377"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:14.668000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-42db33e9-7e21-4fa6-8ef9-dc459ddc977d req-b3ddddd4-4249-4a4b-a77f-ec5480198d89 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:14.668483 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-42db33e9-7e21-4fa6-8ef9-dc459ddc977d req-b3ddddd4-4249-4a4b-a77f-ec5480198d89 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:14.678353 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-42db33e9-7e21-4fa6-8ef9-dc459ddc977d req-b3ddddd4-4249-4a4b-a77f-ec5480198d89 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:14.724818 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-42db33e9-7e21-4fa6-8ef9-dc459ddc977d req-b3ddddd4-4249-4a4b-a77f-ec5480198d89 service nova] Creating event network-vif-deleted:de6ac140-1998-47ee-b791-3c7089ad7377 for instance cacbe115-560c-4934-acc5-ca08bcac81c7 on hv-cinder-79797 Oct 27 09:43:14.735267 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-42db33e9-7e21-4fa6-8ef9-dc459ddc977d req-b3ddddd4-4249-4a4b-a77f-ec5480198d89 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.424456 Oct 27 09:43:14.736209 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 489/969] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:14.935367 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:14.949489 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:14.950982 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:14.952171 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-cd8569a7-5d8c-4a5a-887b-36e9ec75f507 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.370707 Oct 27 09:43:14.952760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 481/970] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:14 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:15.249817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cbf82182-351c-4234-b37c-58c0b7b0053f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:15.250706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cbf82182-351c-4234-b37c-58c0b7b0053f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:15.257179 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cbf82182-351c-4234-b37c-58c0b7b0053f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.257912 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cbf82182-351c-4234-b37c-58c0b7b0053f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.258537 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cbf82182-351c-4234-b37c-58c0b7b0053f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.259408 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cbf82182-351c-4234-b37c-58c0b7b0053f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.260082 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cbf82182-351c-4234-b37c-58c0b7b0053f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.260847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cbf82182-351c-4234-b37c-58c0b7b0053f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.403966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=6 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:15.473656 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cbf82182-351c-4234-b37c-58c0b7b0053f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:15.484065 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cbf82182-351c-4234-b37c-58c0b7b0053f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.241632 Oct 27 09:43:15.496269 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 490/971] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:15 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:15.605943 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:15.606566 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:15.609626 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:15.611012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=6 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:15.619033 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.619942 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.620460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.621195 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.621641 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.622240 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.701249 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:15.701804 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:15.702249 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:15.702715 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'fault' on Instance uuid cacbe115-560c-4934-acc5-ca08bcac81c7 {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:15.757313 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:15.776017 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1d5cd00a-dc91-45a8-9ad4-a483c762bdc0 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1327 microversion: 2.1 time: 0.174331 Oct 27 09:43:15.792931 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 482/972] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:15 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1327 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:15.992877 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:15.994060 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:16.000739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:16.001468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:16.002077 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:16.002944 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:16.003550 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:16.004141 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:16.180706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:16.189019 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:16.190601 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:16.191838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-914a2541-d5c1-4edf-b04e-757ae53ee863 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.202936 Oct 27 09:43:16.192470 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 491/973] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:15 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:16.508279 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b6926f12-a157-481f-b8d8-e5857945a240 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:16.509067 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b6926f12-a157-481f-b8d8-e5857945a240 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:16.515576 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b6926f12-a157-481f-b8d8-e5857945a240 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:16.516060 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b6926f12-a157-481f-b8d8-e5857945a240 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:16.516914 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b6926f12-a157-481f-b8d8-e5857945a240 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:16.517954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b6926f12-a157-481f-b8d8-e5857945a240 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:16.518688 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b6926f12-a157-481f-b8d8-e5857945a240 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:16.519412 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b6926f12-a157-481f-b8d8-e5857945a240 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:16.684040 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b6926f12-a157-481f-b8d8-e5857945a240 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:16.691950 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b6926f12-a157-481f-b8d8-e5857945a240 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.188425 Oct 27 09:43:16.692548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 483/974] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:16 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:16.799741 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:16.800342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:16.808192 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:16.808721 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:16.809172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:16.809946 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:16.810379 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:16.810802 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:16.847495 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:16.847495 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:16.847495 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:16.847495 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'fault' on Instance uuid cacbe115-560c-4934-acc5-ca08bcac81c7 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:16.888071 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:16.897545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b3214b48-d0c1-48fc-b1fe-1c9e2cea6c9f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1327 microversion: 2.1 time: 0.101552 Oct 27 09:43:16.898136 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 492/975] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:16 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:17.219293 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:17.219928 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:17.226691 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:17.227802 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:17.228299 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:17.229127 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:17.229703 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:17.230213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:17.373772 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:17.381783 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:17.383256 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:17.384427 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-23bc186c-005c-4918-88c9-ab429e315bef tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.169107 Oct 27 09:43:17.385021 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 484/976] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:17 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:17.717701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-fdbf58e5-0b6f-4cce-951f-536ddeefdf98 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:17.718484 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-fdbf58e5-0b6f-4cce-951f-536ddeefdf98 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:17.724695 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fdbf58e5-0b6f-4cce-951f-536ddeefdf98 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:17.725180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fdbf58e5-0b6f-4cce-951f-536ddeefdf98 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:17.725617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fdbf58e5-0b6f-4cce-951f-536ddeefdf98 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:17.726364 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fdbf58e5-0b6f-4cce-951f-536ddeefdf98 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:17.727356 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fdbf58e5-0b6f-4cce-951f-536ddeefdf98 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:17.727783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fdbf58e5-0b6f-4cce-951f-536ddeefdf98 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:17.756487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:17.853151 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-179cc5e7-fb1d-4b5e-b35a-9f506c9dd592 req-106c889b-947b-4d95-af04-008791bf86ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6d582c-7b11-474d-ade0-762c6ccee705", "name": "network-vif-plugged", "status": "completed", "tag": "345288e1-68e9-44e4-b75d-e117a08b1f49"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:17.869010 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-179cc5e7-fb1d-4b5e-b35a-9f506c9dd592 req-106c889b-947b-4d95-af04-008791bf86ad service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:17.869456 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-179cc5e7-fb1d-4b5e-b35a-9f506c9dd592 req-106c889b-947b-4d95-af04-008791bf86ad service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:17.880284 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-179cc5e7-fb1d-4b5e-b35a-9f506c9dd592 req-106c889b-947b-4d95-af04-008791bf86ad service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:17.908070 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-179cc5e7-fb1d-4b5e-b35a-9f506c9dd592 req-106c889b-947b-4d95-af04-008791bf86ad service nova] Creating event network-vif-plugged:345288e1-68e9-44e4-b75d-e117a08b1f49 for instance fc6d582c-7b11-474d-ade0-762c6ccee705 on hv-cinder-79797 Oct 27 09:43:17.920880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-179cc5e7-fb1d-4b5e-b35a-9f506c9dd592 req-106c889b-947b-4d95-af04-008791bf86ad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071983 Oct 27 09:43:17.922201 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 485/977] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:43:17.929719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:17.933928 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:17.939331 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:17.943528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:17.944298 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:17.944781 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:17.945538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:17.952553 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:17.953294 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:17.992072 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-fdbf58e5-0b6f-4cce-951f-536ddeefdf98 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:17.995638 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:17.996376 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:17.997146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:17.997996 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'fault' on Instance uuid cacbe115-560c-4934-acc5-ca08bcac81c7 {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:18.001316 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:18.001506 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-fdbf58e5-0b6f-4cce-951f-536ddeefdf98 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.287653 Oct 27 09:43:18.002290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 493/978] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:17 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:18.047687 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:18.056352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-27c0ae31-d279-4bb0-9f60-25b3e631a38f tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1327 microversion: 2.1 time: 0.132744 Oct 27 09:43:18.056955 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 486/979] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:17 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:18.412332 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:18.413143 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:18.422514 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:18.423128 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:18.424018 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:18.424911 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:18.425799 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:18.426367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:18.590879 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:18.604448 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:18.604448 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:18.605036 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0b9033f5-c99e-4c4b-abb2-93a766674437 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.197912 Oct 27 09:43:18.608261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 494/980] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:18 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:19.026143 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6a0f5193-1909-4b36-a68b-b0eb7effe52a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:19.028171 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6a0f5193-1909-4b36-a68b-b0eb7effe52a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:19.035985 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0f5193-1909-4b36-a68b-b0eb7effe52a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:19.037166 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0f5193-1909-4b36-a68b-b0eb7effe52a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:19.037922 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0f5193-1909-4b36-a68b-b0eb7effe52a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:19.039001 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0f5193-1909-4b36-a68b-b0eb7effe52a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:19.039750 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0f5193-1909-4b36-a68b-b0eb7effe52a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:19.040463 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6a0f5193-1909-4b36-a68b-b0eb7effe52a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:19.079681 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:19.080310 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:19.088482 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:19.089000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:19.089651 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:19.090384 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:19.090847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:19.091277 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:19.128750 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:19.129843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:19.129843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:19.130147 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'fault' on Instance uuid cacbe115-560c-4934-acc5-ca08bcac81c7 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:19.185409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:19.193989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-179169bc-535d-4d2e-90cf-c126f9df5882 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1327 microversion: 2.1 time: 0.118094 Oct 27 09:43:19.198601 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 495/981] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:19 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:19.217351 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6a0f5193-1909-4b36-a68b-b0eb7effe52a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:19.225732 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6a0f5193-1909-4b36-a68b-b0eb7effe52a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.203367 Oct 27 09:43:19.226431 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 487/982] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:19 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:19.630599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:19.631557 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:19.639477 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:19.640124 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:19.640596 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:19.641402 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:19.641908 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:19.642343 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:19.790880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:19.799362 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:19.800825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:19.802110 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f7ce6c25-ed65-4f51-bde3-8b99ac86fdf0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.175384 Oct 27 09:43:19.803124 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 496/983] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:19 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:20.223927 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:20.224484 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:20.233485 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:20.233988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:20.234511 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:20.235416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:20.235892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:20.236395 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:20.254192 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-fd4a520c-3ee5-405e-bc04-b9f8707ffade tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:20.254848 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-fd4a520c-3ee5-405e-bc04-b9f8707ffade tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:20.264411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fd4a520c-3ee5-405e-bc04-b9f8707ffade tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:20.265228 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fd4a520c-3ee5-405e-bc04-b9f8707ffade tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:20.265658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fd4a520c-3ee5-405e-bc04-b9f8707ffade tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:20.266355 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fd4a520c-3ee5-405e-bc04-b9f8707ffade tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:20.266802 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fd4a520c-3ee5-405e-bc04-b9f8707ffade tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:20.267218 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-fd4a520c-3ee5-405e-bc04-b9f8707ffade tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:20.293417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:20.294043 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:20.295106 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:20.295787 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'fault' on Instance uuid cacbe115-560c-4934-acc5-ca08bcac81c7 {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:20.376217 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:20.384064 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4b52e756-a08d-4cf1-a3ed-f9da08fc036e tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1327 microversion: 2.1 time: 0.165443 Oct 27 09:43:20.384901 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 488/984] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:20 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1327 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:20.462246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-fd4a520c-3ee5-405e-bc04-b9f8707ffade tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:20.472458 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-fd4a520c-3ee5-405e-bc04-b9f8707ffade tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.222560 Oct 27 09:43:20.485193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 497/985] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:20 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:20.831242 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:20.833886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:20.845758 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:20.846332 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:20.846777 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:20.847546 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:20.847999 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:20.848422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:20.997057 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:21.005942 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:21.007377 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:21.009180 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f960026c-5673-4379-8d2d-c2962346cdcc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.184162 Oct 27 09:43:21.009933 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 489/986] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:20 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:21.408704 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:21.409468 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:21.416572 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:21.417417 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:21.418235 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:21.419455 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:21.420188 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:21.420906 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:21.498300 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6c2cd036-cb3b-40c7-9770-4b155a50fc14 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:21.499695 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6c2cd036-cb3b-40c7-9770-4b155a50fc14 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:21.508188 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6c2cd036-cb3b-40c7-9770-4b155a50fc14 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:21.509116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6c2cd036-cb3b-40c7-9770-4b155a50fc14 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:21.509777 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6c2cd036-cb3b-40c7-9770-4b155a50fc14 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:21.510833 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6c2cd036-cb3b-40c7-9770-4b155a50fc14 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:21.511525 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6c2cd036-cb3b-40c7-9770-4b155a50fc14 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:21.512231 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6c2cd036-cb3b-40c7-9770-4b155a50fc14 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:21.609955 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:21.610724 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:21.611312 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:21.611922 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'fault' on Instance uuid cacbe115-560c-4934-acc5-ca08bcac81c7 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:21.671309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:21.680202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4213179a-6d0e-4688-9955-12605d1b8a95 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1327 microversion: 2.1 time: 0.274934 Oct 27 09:43:21.681278 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 498/987] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:21 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1327 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:21.710209 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6c2cd036-cb3b-40c7-9770-4b155a50fc14 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:21.719845 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6c2cd036-cb3b-40c7-9770-4b155a50fc14 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.225365 Oct 27 09:43:21.720717 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 490/988] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:21 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:43:22.034933 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:22.035543 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:22.042274 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:22.042765 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:22.043200 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:22.044198 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:22.044675 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:22.045098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:22.186153 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:22.194454 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:22.196418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:22.197645 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6241e331-2f62-493a-bcf8-8343b2c40482 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.166894 Oct 27 09:43:22.198202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 499/989] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:22 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:22.703501 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:22.704089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:22.710525 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:22.712447 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:22.712916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:22.713614 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:22.714063 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:22.714484 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:22.743999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1d404924-5373-4aaf-a74f-11631ecbc014 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:22.745675 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1d404924-5373-4aaf-a74f-11631ecbc014 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:22.750061 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:22.750563 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:22.751003 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:22.751459 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'fault' on Instance uuid cacbe115-560c-4934-acc5-ca08bcac81c7 {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:22.756337 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d404924-5373-4aaf-a74f-11631ecbc014 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:22.757256 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d404924-5373-4aaf-a74f-11631ecbc014 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:22.758203 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d404924-5373-4aaf-a74f-11631ecbc014 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:22.758940 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d404924-5373-4aaf-a74f-11631ecbc014 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:22.759397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d404924-5373-4aaf-a74f-11631ecbc014 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:22.759820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d404924-5373-4aaf-a74f-11631ecbc014 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:22.796536 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:22.811487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-f4ff6884-2184-4311-bf09-b4328ab850d6 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1327 microversion: 2.1 time: 0.111483 Oct 27 09:43:22.829396 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 491/990] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:22 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:22.915763 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1d404924-5373-4aaf-a74f-11631ecbc014 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:22.924823 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1d404924-5373-4aaf-a74f-11631ecbc014 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.184924 Oct 27 09:43:22.925419 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 500/991] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:22 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:23.224482 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:23.225258 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:23.231888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:23.232367 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:23.232829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:23.233522 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:23.233970 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:23.234388 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:23.371178 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:23.379337 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:23.380806 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:23.381962 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ce989a9f-acf2-4b71-984c-6e02bd9e1d61 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.161489 Oct 27 09:43:23.382520 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 492/992] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:23 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 09:43:23.836959 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:23.837573 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:23.844005 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:23.844491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:23.844965 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:23.845675 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:23.846135 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:23.846587 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:23.877321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:23.877801 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:23.878235 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:23.878677 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lazy-loading 'fault' on Instance uuid cacbe115-560c-4934-acc5-ca08bcac81c7 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:43:23.919903 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '286df4c587d7408d988c4739f4ff923a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71d1c4930a1b487eb3dca8fde6ce424a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:23.927850 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c814d471-7394-410a-87eb-aec2793e482a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 200 len: 1327 microversion: 2.1 time: 0.095457 Oct 27 09:43:23.928414 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 501/993] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:23 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:23.947879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1f570993-997a-4958-b074-ba17a4cf6251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:23.948487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1f570993-997a-4958-b074-ba17a4cf6251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:23.955080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f570993-997a-4958-b074-ba17a4cf6251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:23.955556 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f570993-997a-4958-b074-ba17a4cf6251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:23.955987 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f570993-997a-4958-b074-ba17a4cf6251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:23.956692 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f570993-997a-4958-b074-ba17a4cf6251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:23.957143 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f570993-997a-4958-b074-ba17a4cf6251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:23.957562 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1f570993-997a-4958-b074-ba17a4cf6251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:24.083935 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1f570993-997a-4958-b074-ba17a4cf6251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:24.091411 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1f570993-997a-4958-b074-ba17a4cf6251 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.147279 Oct 27 09:43:24.092008 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 493/994] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:23 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:24.407607 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:24.408226 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:24.414375 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:24.414864 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:24.415319 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:24.416017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:24.416467 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:24.416924 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:24.560921 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:24.568991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:24.570433 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:24.572244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-51e51d7d-f256-4c76-8dfc-43c4b29ff1bc tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.168120 Oct 27 09:43:24.572927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 502/995] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:24 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:24.950136 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:24.950801 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:24.957115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:24.957595 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:24.958026 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:24.958712 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:24.959162 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:24.959586 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:24.973354 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] HTTP exception thrown: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Request method failure captured: Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 HTTP/1.1 Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEoE9vMrezrYrgpDoB-JIU0ai9jfRlsakZ4KZSHyMVXFvEteMLaep9-x2QkIEv_WAa7ld411vUXTdKRqcVHszWIRe0x7GfTJMBh9zGCPtsjIM-esQ8xnqY4yyXNmRTsHztkULkwoJl4N_kC_dr0K1p0hhuOsUydo2iInlWenoM5vGI Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:43:24.974981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 286df4c587d7408d988c4739f4ff923a Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:24.976610 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': 'cacbe115-560c-4934-acc5-ca08bcac81c7'} Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:43:24.977494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:24.979613 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:24.981460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Returning 404 to user: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:43:24.981460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-412e581c-3fa1-405b-887f-8172ebc66431 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 404 len: 111 microversion: 2.1 time: 0.030505 Oct 27 09:43:24.981460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 494/996] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:24 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:43:24.985759 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ef3ba848-935e-4af5-9943-0fa5c6f3a827 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '.version_select at 0x7f36492b2dc0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:25.004305 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ef3ba848-935e-4af5-9943-0fa5c6f3a827 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086131415" status: 202 len: 0 microversion: 2.1 time: 0.022275 Oct 27 09:43:25.004889 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 503/997] 10.222.0.70 () {58 vars in 1221 bytes} [Thu Oct 27 09:43:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1086131415 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:43:25.115033 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5579923a-cccb-4ab0-a6d2-9b2add57a68f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:25.115770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-5579923a-cccb-4ab0-a6d2-9b2add57a68f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:25.122455 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5579923a-cccb-4ab0-a6d2-9b2add57a68f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:25.122934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5579923a-cccb-4ab0-a6d2-9b2add57a68f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:25.123442 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5579923a-cccb-4ab0-a6d2-9b2add57a68f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:25.124155 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5579923a-cccb-4ab0-a6d2-9b2add57a68f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:25.124631 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5579923a-cccb-4ab0-a6d2-9b2add57a68f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:25.125052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-5579923a-cccb-4ab0-a6d2-9b2add57a68f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:25.370957 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-5579923a-cccb-4ab0-a6d2-9b2add57a68f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:25.378523 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5579923a-cccb-4ab0-a6d2-9b2add57a68f tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.267761 Oct 27 09:43:25.379081 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 495/998] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:25 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:25.598431 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:25.599058 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:25.605568 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:25.606086 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:25.606523 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:25.607219 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:25.607675 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:25.608103 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:25.753969 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:25.762658 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:25.764203 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:25.765619 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-6bf9363b-23fb-4615-81d2-1d28f928b0c7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.171374 Oct 27 09:43:25.766168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 504/999] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:25 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:26.403243 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4b744588-4f6e-4986-b411-3d5ef076ece0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:26.403855 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4b744588-4f6e-4986-b411-3d5ef076ece0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:26.410487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b744588-4f6e-4986-b411-3d5ef076ece0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:26.410970 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b744588-4f6e-4986-b411-3d5ef076ece0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:26.411406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b744588-4f6e-4986-b411-3d5ef076ece0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:26.412149 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b744588-4f6e-4986-b411-3d5ef076ece0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:26.412580 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b744588-4f6e-4986-b411-3d5ef076ece0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:26.413007 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4b744588-4f6e-4986-b411-3d5ef076ece0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:26.538898 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4b744588-4f6e-4986-b411-3d5ef076ece0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:26.546562 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4b744588-4f6e-4986-b411-3d5ef076ece0 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1366 microversion: 2.1 time: 0.147762 Oct 27 09:43:26.547119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 496/1000] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:26 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:26.792339 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:26.792906 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:26.799261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:26.799745 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:26.800181 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:26.800902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:26.801356 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:26.801779 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:26.943092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:26.951560 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:26.953100 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:26.954252 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d0213c4d-b231-4097-8916-68a10fc19daf tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.166023 Oct 27 09:43:26.954798 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 505/1001] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:26 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:27.570056 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-78e78709-0591-4089-ad41-669a077f558a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:27.570673 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-78e78709-0591-4089-ad41-669a077f558a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:27.577918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78e78709-0591-4089-ad41-669a077f558a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:27.578406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78e78709-0591-4089-ad41-669a077f558a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:27.578864 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78e78709-0591-4089-ad41-669a077f558a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:27.579563 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78e78709-0591-4089-ad41-669a077f558a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:27.580021 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78e78709-0591-4089-ad41-669a077f558a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:27.580476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-78e78709-0591-4089-ad41-669a077f558a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:27.709052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-78e78709-0591-4089-ad41-669a077f558a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:27.717429 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-78e78709-0591-4089-ad41-669a077f558a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1556 microversion: 2.1 time: 0.151214 Oct 27 09:43:27.717999 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 497/1002] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:27 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:27.740065 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-43467749-1787-45b6-9cf2-8656559a3259 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:27.740580 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-43467749-1787-45b6-9cf2-8656559a3259 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:27.746513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43467749-1787-45b6-9cf2-8656559a3259 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:27.747000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43467749-1787-45b6-9cf2-8656559a3259 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:27.747439 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43467749-1787-45b6-9cf2-8656559a3259 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:27.748134 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43467749-1787-45b6-9cf2-8656559a3259 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:27.748622 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43467749-1787-45b6-9cf2-8656559a3259 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:27.749041 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-43467749-1787-45b6-9cf2-8656559a3259 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:27.826656 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-43467749-1787-45b6-9cf2-8656559a3259 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090474 Oct 27 09:43:27.827568 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 506/1003] 10.222.0.70 () {58 vars in 1275 bytes} [Thu Oct 27 09:43:27 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:27.984790 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:27.985297 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:27.987701 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:27.988602 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:27.994324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:27.994930 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:27.995449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:27.995816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:27.996383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:27.996698 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:27.997297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:27.997435 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:27.997928 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:27.998469 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:27.999087 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:27.999674 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:28.013386 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] HTTP exception thrown: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Request method failure captured: Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: DELETE /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 HTTP/1.1 Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEoE9vMrezrYrgpDoB-JIU0ai9jfRlsakZ4KZSHyMVXFvEteMLaep9-x2QkIEv_WAa7ld411vUXTdKRqcVHszWIRe0x7GfTJMBh9zGCPtsjIM-esQ8xnqY4yyXNmRTsHztkULkwoJl4N_kC_dr0K1p0hhuOsUydo2iInlWenoM5vGI Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:43:28.015239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 286df4c587d7408d988c4739f4ff923a Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:28.016822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': 'cacbe115-560c-4934-acc5-ca08bcac81c7'} Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:43:28.017757 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:28.019275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:28.020731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Returning 404 to user: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:43:28.021444 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1ade7575-ea52-4408-adf8-e99ebb04143a tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 404 len: 111 microversion: 2.1 time: 0.040768 Oct 27 09:43:28.022436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 507/1004] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:43:27 2022] DELETE /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:43:28.031084 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:28.031957 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: cacbe115-560c-4934-acc5-ca08bcac81c7] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:28.038709 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:28.039457 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:28.040090 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:28.041047 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:28.042249 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:28.042859 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:28.063910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] HTTP exception thrown: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Request method failure captured: Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 HTTP/1.1 Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEoE9vMrezrYrgpDoB-JIU0ai9jfRlsakZ4KZSHyMVXFvEteMLaep9-x2QkIEv_WAa7ld411vUXTdKRqcVHszWIRe0x7GfTJMBh9zGCPtsjIM-esQ8xnqY4yyXNmRTsHztkULkwoJl4N_kC_dr0K1p0hhuOsUydo2iInlWenoM5vGI Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:43:28.066261 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 286df4c587d7408d988c4739f4ff923a Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:28.067661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': 'cacbe115-560c-4934-acc5-ca08bcac81c7'} Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:43:28.068383 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. Oct 27 09:43:28.069834 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:28.071037 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Returning 404 to user: Instance cacbe115-560c-4934-acc5-ca08bcac81c7 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:43:28.071037 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-102bf4ef-1ba5-4f87-b6ee-4001ef632c72 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7" status: 404 len: 111 microversion: 2.1 time: 0.040970 Oct 27 09:43:28.073325 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 508/1005] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:28 2022] GET /compute/v2.1/servers/cacbe115-560c-4934-acc5-ca08bcac81c7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:43:28.299963 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:28.309069 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:28.310748 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:28.311909 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2e859245-7a9f-47fb-8af4-11a80013fa6a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.336519 Oct 27 09:43:28.328635 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 498/1006] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:27 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:29.153763 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-3e5c611a-a64e-4dc2-8e92-99bf01ddcf39 req-3eb3c6ce-4195-4bbd-b18f-f22ec4ddf30d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc6d582c-7b11-474d-ade0-762c6ccee705", "tag": "345288e1-68e9-44e4-b75d-e117a08b1f49"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:29.163659 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-3e5c611a-a64e-4dc2-8e92-99bf01ddcf39 req-3eb3c6ce-4195-4bbd-b18f-f22ec4ddf30d service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:29.164142 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-3e5c611a-a64e-4dc2-8e92-99bf01ddcf39 req-3eb3c6ce-4195-4bbd-b18f-f22ec4ddf30d service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:29.164604 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-3e5c611a-a64e-4dc2-8e92-99bf01ddcf39 req-3eb3c6ce-4195-4bbd-b18f-f22ec4ddf30d service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:29.176064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-3e5c611a-a64e-4dc2-8e92-99bf01ddcf39 req-3eb3c6ce-4195-4bbd-b18f-f22ec4ddf30d service nova] Creating event network-changed:345288e1-68e9-44e4-b75d-e117a08b1f49 for instance fc6d582c-7b11-474d-ade0-762c6ccee705 on hv-cinder-79797 Oct 27 09:43:29.181258 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-3e5c611a-a64e-4dc2-8e92-99bf01ddcf39 req-3eb3c6ce-4195-4bbd-b18f-f22ec4ddf30d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031003 Oct 27 09:43:29.182597 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 509/1007] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:29.261441 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:29.261986 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:29.268971 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:29.269727 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:29.270380 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:29.271288 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:29.271936 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:29.272587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:29.289764 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] HTTP exception thrown: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Request method failure captured: Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: DELETE /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c HTTP/1.1 Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEoE9vMrezrYrgpDoB-JIU0ai9jfRlsakZ4KZSHyMVXFvEteMLaep9-x2QkIEv_WAa7ld411vUXTdKRqcVHszWIRe0x7GfTJMBh9zGCPtsjIM-esQ8xnqY4yyXNmRTsHztkULkwoJl4N_kC_dr0K1p0hhuOsUydo2iInlWenoM5vGI Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:43:29.291910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 286df4c587d7408d988c4739f4ff923a Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:43:29.293491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '5232c748-ed0e-4ba8-a76d-1b8b9ffd523c'} Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:43:29.294383 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:43:29.295811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:29.297747 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Returning 404 to user: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:43:29.297747 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3a662948-3650-4adf-818d-88c49d5ed16b tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 404 len: 111 microversion: 2.1 time: 0.037157 Oct 27 09:43:29.297747 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 499/1008] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:43:29 2022] DELETE /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:43:29.305125 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:29.305818 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] [instance: 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:29.312819 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:29.313545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:29.313975 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:29.314660 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:29.315275 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:29.315694 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:29.330402 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] HTTP exception thrown: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Request method failure captured: Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c HTTP/1.1 Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEoE9vMrezrYrgpDoB-JIU0ai9jfRlsakZ4KZSHyMVXFvEteMLaep9-x2QkIEv_WAa7ld411vUXTdKRqcVHszWIRe0x7GfTJMBh9zGCPtsjIM-esQ8xnqY4yyXNmRTsHztkULkwoJl4N_kC_dr0K1p0hhuOsUydo2iInlWenoM5vGI Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:43:29.332091 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_71d1c4930a1b487eb3dca8fde6ce424a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 71d1c4930a1b487eb3dca8fde6ce424a Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2091910305 Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 286df4c587d7408d988c4739f4ff923a Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeTestJSON-2091910305-project Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:43:29.333500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '5232c748-ed0e-4ba8-a76d-1b8b9ffd523c'} Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:43:29.334222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. Oct 27 09:43:29.335617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:43:29.337337 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] Returning 404 to user: Instance 5232c748-ed0e-4ba8-a76d-1b8b9ffd523c could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:43:29.337337 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-edb98189-5bb3-4026-8dad-8ddcbbec6d09 tempest-AttachVolumeTestJSON-2091910305 tempest-AttachVolumeTestJSON-2091910305-project] 10.222.0.70 "GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c" status: 404 len: 111 microversion: 2.1 time: 0.032594 Oct 27 09:43:29.337670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 510/1009] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:29 2022] GET /compute/v2.1/servers/5232c748-ed0e-4ba8-a76d-1b8b9ffd523c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:43:29.346135 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:29.346939 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:29.354252 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:29.354947 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:29.355686 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:29.356759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:29.357210 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:29.357792 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:29.519864 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:29.533647 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:29.535198 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:29.537516 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-61cc60f5-c9f5-42c3-af60-cef22ff2f169 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.195835 Oct 27 09:43:29.550237 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 500/1010] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:29 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:30.094022 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-155887b0-3d1a-45c4-957a-ca7f01c72910 req-6877e079-2c36-4061-a054-b52fad559874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a898b1b-5c82-41b1-8b68-0ad30a3516a1", "name": "network-vif-plugged", "status": "completed", "tag": "c4193921-efc0-4d0e-8a62-50ecf8de25b1"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:30.104268 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-155887b0-3d1a-45c4-957a-ca7f01c72910 req-6877e079-2c36-4061-a054-b52fad559874 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:30.104866 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-155887b0-3d1a-45c4-957a-ca7f01c72910 req-6877e079-2c36-4061-a054-b52fad559874 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:30.105524 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-155887b0-3d1a-45c4-957a-ca7f01c72910 req-6877e079-2c36-4061-a054-b52fad559874 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:30.118179 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-155887b0-3d1a-45c4-957a-ca7f01c72910 req-6877e079-2c36-4061-a054-b52fad559874 service nova] Creating event network-vif-plugged:c4193921-efc0-4d0e-8a62-50ecf8de25b1 for instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 on hv-cinder-79797 Oct 27 09:43:30.123375 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-155887b0-3d1a-45c4-957a-ca7f01c72910 req-6877e079-2c36-4061-a054-b52fad559874 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033575 Oct 27 09:43:30.123965 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 511/1011] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:30.566875 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:30.568116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:30.575680 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:30.576195 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:30.576735 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:30.577643 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:30.578255 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:30.578846 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:30.814607 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:30.827587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:30.831295 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:30.832686 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-191d2d20-d75f-4208-980e-87da85470bc6 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.269650 Oct 27 09:43:30.833822 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 501/1012] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:30 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:31.860064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:31.860878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:31.869798 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:31.872163 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:31.872163 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:31.872163 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:31.872163 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:31.872577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:32.146878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:32.156628 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:32.160069 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:32.160069 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-28a47a7f-9ae3-44dd-b776-18f0c6f8d15b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.304236 Oct 27 09:43:32.172849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 512/1013] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:31 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:33.186146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:33.186827 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:33.197246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:33.197246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:33.197246 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:33.197962 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:33.199664 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:33.200115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:33.348234 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:33.357576 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:33.359025 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:33.360213 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-422e7f65-83fb-4a93-accd-8f9d5cf96c9a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.179903 Oct 27 09:43:33.360818 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 502/1014] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:33 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:34.376677 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ca968247-d272-4bee-843c-c9112ab3637e tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] Action: 'create', calling method: .version_select at 0x7f36491ab5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1816251534", "metadata": {"Type": "work"}}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:34.387054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:34.387698 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:34.394433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:34.394910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:34.395393 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:34.396391 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:34.396970 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:34.397517 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:34.553726 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:34.556042 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=100 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:34.565955 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:34.567879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:34.569447 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d06d1607-5f6b-4818-a573-2bd7e234671a tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1727 microversion: 2.20 time: 0.186872 Oct 27 09:43:34.585398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 503/1015] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:34 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1727 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:34.734124 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ca968247-d272-4bee-843c-c9112ab3637e tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.474165 Oct 27 09:43:34.734984 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 513/1016] 10.222.0.70 () {60 vars in 1156 bytes} [Thu Oct 27 09:43:34 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 476 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 09:43:34.748335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d8d9826a-05ca-4964-ac83-816086c541a5 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] Calling method '.version_select at 0x7f36496cd700>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:34.807380 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d8d9826a-05ca-4964-ac83-816086c541a5 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461" status: 200 len: 353 microversion: 2.1 time: 0.063128 Oct 27 09:43:34.808001 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 504/1017] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:43:34 2022] GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:35.600297 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:35.600937 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:35.608248 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:35.608765 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:35.609206 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:35.609901 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:35.610362 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:35.610787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:35.740076 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:35.743610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:35.750522 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:35.751995 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:35.753205 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2382d1e0-6a48-4719-ac71-618ad7c66a8d tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1714 microversion: 2.20 time: 0.157489 Oct 27 09:43:35.753741 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 514/1018] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:43:35 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:43:35.821982 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-89ee522f-a9e1-4f43-a4da-c06760de2ddd tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] Calling method '.version_select at 0x7f364948cc10>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:35.871305 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-89ee522f-a9e1-4f43-a4da-c06760de2ddd tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461" status: 200 len: 354 microversion: 2.1 time: 0.053665 Oct 27 09:43:35.871879 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 505/1019] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:43:35 2022] GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:35.884724 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9dd3222a-b464-459e-921a-17dab36c9bb6 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] Calling method '.version_select at 0x7f3649260f70>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:35.931248 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9dd3222a-b464-459e-921a-17dab36c9bb6 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461" status: 200 len: 354 microversion: 2.1 time: 0.050452 Oct 27 09:43:35.931810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 515/1020] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:43:35 2022] GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:35.944729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fb17c8cf-8c16-4f3f-a6dc-69d43f728658 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] Calling method '.version_select at 0x7f36497329d0>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:36.005322 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fb17c8cf-8c16-4f3f-a6dc-69d43f728658 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461" status: 202 len: 0 microversion: 2.1 time: 0.064327 Oct 27 09:43:36.005929 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 506/1021] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Oct 27 09:43:35 2022] DELETE /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:43:36.014047 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-47b1b37f-ba63-4aec-9d79-1e9463dc2fe4 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] Calling method '.version_select at 0x7f36492b45e0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:36.067176 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-47b1b37f-ba63-4aec-9d79-1e9463dc2fe4 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461" status: 200 len: 353 microversion: 2.1 time: 0.057049 Oct 27 09:43:36.067742 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 516/1022] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:43:36 2022] GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:37.081450 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8a048a48-cf7a-468d-bbd1-acbd6013ed37 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] Calling method '.version_select at 0x7f364970f4c0>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:37.109014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-8a048a48-cf7a-468d-bbd1-acbd6013ed37 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] HTTP exception thrown: Volume 66450ea5-85bc-4780-8e6b-bbaa08c46461 could not be found. Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8a048a48-cf7a-468d-bbd1-acbd6013ed37 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] Request method failure captured: Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461 HTTP/1.1 Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlLGwaxWZOg2NHu9dwuyx31oOmoRPQdbKnoUwOFDXM_ZLvb0WnXSao3QurJyML58C3WgX8XUvryzAn46aDl0qBS2yn2K44b60VhjhnH6eymvveV_XcmG67BatDns4Wz3_h09PRaEFAE2ctbprP1CSMGDyrXj90RP8gS9lHoSh5xWF8w Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 6e307e105e324d5ea679bb563088b142 Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-VolumesGetTestJSON-498102102 Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:43:37.110954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6e307e105e324d5ea679bb563088b142"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e307e105e324d5ea679bb563088b142"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6e307e105e324d5ea679bb563088b142"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6e307e105e324d5ea679bb563088b142"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-VolumesGetTestJSON-498102102 Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 6e307e105e324d5ea679bb563088b142 Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-VolumesGetTestJSON-498102102 Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-VolumesGetTestJSON-498102102-project Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: aebd611119b840a0b8ebfb8d14055cfb Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-VolumesGetTestJSON-498102102-project Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Volume 66450ea5-85bc-4780-8e6b-bbaa08c46461 could not be found. Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '66450ea5-85bc-4780-8e6b-bbaa08c46461'} Oct 27 09:43:37.112487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66450ea5-85bc-4780-8e6b-bbaa08c46461 could not be found. (HTTP 404) (Request-ID: req-04020ac5-4a0a-4edb-a8b3-719e2071cb35) Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:37.113513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 09:43:37.114896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66450ea5-85bc-4780-8e6b-bbaa08c46461 could not be found. Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 09:43:37.116289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66450ea5-85bc-4780-8e6b-bbaa08c46461 could not be found. Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66450ea5-85bc-4780-8e6b-bbaa08c46461 could not be found. Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8a048a48-cf7a-468d-bbd1-acbd6013ed37 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] Returning 404 to user: Volume 66450ea5-85bc-4780-8e6b-bbaa08c46461 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8a048a48-cf7a-468d-bbd1-acbd6013ed37 tempest-VolumesGetTestJSON-498102102 tempest-VolumesGetTestJSON-498102102-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461" status: 404 len: 109 microversion: 2.1 time: 0.035392 Oct 27 09:43:37.117820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 507/1023] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:43:37 2022] GET /compute/v2.1/os-volumes/66450ea5-85bc-4780-8e6b-bbaa08c46461 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:43:39.972463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d90f8171-63d0-49e1-a30d-cd318167ccdf tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f364931d550>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:40.019853 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d90f8171-63d0-49e1-a30d-cd318167ccdf tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/e3252305-26f8-4c57-8dd4-6ce77268a723" status: 200 len: 350 microversion: 2.1 time: 0.051579 Oct 27 09:43:40.020415 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 517/1024] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:43:39 2022] GET /compute/v2.1/os-volumes/e3252305-26f8-4c57-8dd4-6ce77268a723 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:41.384273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8bfe469b-2b9e-477a-919d-7b38ad0e728c tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f364948ce50>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:41.441437 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8bfe469b-2b9e-477a-919d-7b38ad0e728c tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/433aed80-77f4-49d0-aed5-95396176965b" status: 200 len: 350 microversion: 2.1 time: 0.061460 Oct 27 09:43:41.442617 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 508/1025] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:43:41 2022] GET /compute/v2.1/os-volumes/433aed80-77f4-49d0-aed5-95396176965b => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:42.831809 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8ae54bb6-a43d-45f8-b406-52a304ee8d88 tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f36492f5ca0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:42.911597 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8ae54bb6-a43d-45f8-b406-52a304ee8d88 tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/2d259e0b-6c7a-49cc-a0e9-5958d1cb61d1" status: 200 len: 351 microversion: 2.1 time: 0.083820 Oct 27 09:43:42.912470 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 518/1026] 10.222.0.70 () {58 vars in 1245 bytes} [Thu Oct 27 09:43:42 2022] GET /compute/v2.1/os-volumes/2d259e0b-6c7a-49cc-a0e9-5958d1cb61d1 => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:42.930944 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-022e810b-c472-433d-b4b0-6cb4f31f34d2 tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f36494a2430>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:43.058122 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-022e810b-c472-433d-b4b0-6cb4f31f34d2 tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.133442 Oct 27 09:43:43.069562 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 509/1027] 10.222.0.70 () {58 vars in 1134 bytes} [Thu Oct 27 09:43:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:43.077424 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-80e1f5dc-fa74-4b66-9cb3-3a4fb78a7e92 tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f3649260160>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:43.193822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-80e1f5dc-fa74-4b66-9cb3-3a4fb78a7e92 tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.122799 Oct 27 09:43:43.194919 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 519/1028] 10.222.0.70 () {58 vars in 1149 bytes} [Thu Oct 27 09:43:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:43.217241 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-0398dcd8-49be-4b15-a798-cad5629356da tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f364944aca0>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:43.327854 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-0398dcd8-49be-4b15-a798-cad5629356da tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.119967 Oct 27 09:43:43.329199 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 510/1029] 10.222.0.70 () {58 vars in 1134 bytes} [Thu Oct 27 09:43:43 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:43.343599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4b355321-62ae-4445-a216-321122de48ea tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f364918c3a0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:43.434901 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4b355321-62ae-4445-a216-321122de48ea tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.096040 Oct 27 09:43:43.435470 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 520/1030] 10.222.0.70 () {58 vars in 1167 bytes} [Thu Oct 27 09:43:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:43.451756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-5df647d7-9571-4e84-9094-6a369d498a10 tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f364949da60>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:43.550028 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-5df647d7-9571-4e84-9094-6a369d498a10 tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.104502 Oct 27 09:43:43.550805 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 511/1031] 10.222.0.70 () {58 vars in 1170 bytes} [Thu Oct 27 09:43:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:43.568459 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5146237c-f1a6-4404-996f-3f4e379be159 tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f3649306a60>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:43.660902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5146237c-f1a6-4404-996f-3f4e379be159 tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.098358 Oct 27 09:43:43.661743 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 521/1032] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Oct 27 09:43:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:43.675814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-60356d6a-a554-4bd5-831e-49e2b15b455f tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f364954e4c0>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:43.795221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-60356d6a-a554-4bd5-831e-49e2b15b455f tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.121929 Oct 27 09:43:43.796349 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 512/1033] 10.222.0.70 () {58 vars in 1188 bytes} [Thu Oct 27 09:43:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:43.812342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a4d1cb04-3f6f-4c98-891d-b523be84017d tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] Calling method '.version_select at 0x7f364931daf0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:43.922047 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a4d1cb04-3f6f-4c98-891d-b523be84017d tempest-VolumesTestJSON-1534271379 tempest-VolumesTestJSON-1534271379-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.116254 Oct 27 09:43:43.924397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 522/1034] 10.222.0.70 () {58 vars in 1155 bytes} [Thu Oct 27 09:43:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:50.241080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=41 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:50.242063 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:50.565285 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-3492903a-80ba-434f-a894-cabf50a8256b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Action: 'create', calling method: .version_select at 0x7f36494a2700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1203524332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZNijmYmhGRIl7TksiqVCOmw3U1bLghlDN8+9pJLVUtyAtGEMF9ncvML7UulKjNEJrs/TWBUofXCiK0a5A2NJkpgKbnUWSLtDOCMK2huobPbGj+UbyMbNZSzkJ8VxEhrA=="}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:50.585174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-3492903a-80ba-434f-a894-cabf50a8256b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Getting quotas for project 4ee2066bcc7240f9a63d5c11a2b04a18. Resources: {'key_pairs'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:43:50.589713 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-3492903a-80ba-434f-a894-cabf50a8256b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Getting quotas for user 127c4fdd8f2b40ae8d98208d64a7f20d and project 4ee2066bcc7240f9a63d5c11a2b04a18. Resources: {'key_pairs'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:43:50.621248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-3492903a-80ba-434f-a894-cabf50a8256b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.381242 Oct 27 09:43:50.621887 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 513/1035] 10.222.0.70 () {60 vars in 1159 bytes} [Thu Oct 27 09:43:50 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:55.021066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cb54ce4d-da72-4420-99e7-848d375281b9 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:55.021586 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-cc067d2d-96b7-4ce6-a62a-464eec665542 req-d8abfc00-49c9-40d9-80f6-84677bf89bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596c5c1c-3555-40e9-a2d3-6c6300478846", "tag": "af533890-8a09-4e93-ac93-881cbb38ca23"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:55.021983 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cb54ce4d-da72-4420-99e7-848d375281b9 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:55.024542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:43:55.031133 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb54ce4d-da72-4420-99e7-848d375281b9 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:55.031541 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-cc067d2d-96b7-4ce6-a62a-464eec665542 req-d8abfc00-49c9-40d9-80f6-84677bf89bf0 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:55.031768 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb54ce4d-da72-4420-99e7-848d375281b9 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:55.032020 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-cc067d2d-96b7-4ce6-a62a-464eec665542 req-d8abfc00-49c9-40d9-80f6-84677bf89bf0 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:55.032331 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb54ce4d-da72-4420-99e7-848d375281b9 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:55.032447 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-cc067d2d-96b7-4ce6-a62a-464eec665542 req-d8abfc00-49c9-40d9-80f6-84677bf89bf0 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:55.033170 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb54ce4d-da72-4420-99e7-848d375281b9 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:55.033797 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb54ce4d-da72-4420-99e7-848d375281b9 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:55.034462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb54ce4d-da72-4420-99e7-848d375281b9 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:55.052010 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-cc067d2d-96b7-4ce6-a62a-464eec665542 req-d8abfc00-49c9-40d9-80f6-84677bf89bf0 service nova] Creating event network-changed:af533890-8a09-4e93-ac93-881cbb38ca23 for instance 596c5c1c-3555-40e9-a2d3-6c6300478846 on hv-cinder-79797 Oct 27 09:43:55.059524 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-cc067d2d-96b7-4ce6-a62a-464eec665542 req-d8abfc00-49c9-40d9-80f6-84677bf89bf0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041392 Oct 27 09:43:55.060385 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 514/1036] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:43:55.067257 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cb54ce4d-da72-4420-99e7-848d375281b9 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Going to try to terminate instance {{(pid=125361) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:43:55.145022 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cb54ce4d-da72-4420-99e7-848d375281b9 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "DELETE /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 204 len: 0 microversion: 2.1 time: 0.130652 Oct 27 09:43:55.145795 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 523/1037] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:43:55 2022] DELETE /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:43:55.154577 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a75aeb85-43ca-4e1d-9237-3ea653331747 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:55.155402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a75aeb85-43ca-4e1d-9237-3ea653331747 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:55.161734 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a75aeb85-43ca-4e1d-9237-3ea653331747 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:55.162292 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a75aeb85-43ca-4e1d-9237-3ea653331747 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:55.162828 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a75aeb85-43ca-4e1d-9237-3ea653331747 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:55.163583 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a75aeb85-43ca-4e1d-9237-3ea653331747 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:55.164106 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a75aeb85-43ca-4e1d-9237-3ea653331747 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:55.164649 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a75aeb85-43ca-4e1d-9237-3ea653331747 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:55.333509 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a75aeb85-43ca-4e1d-9237-3ea653331747 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:55.341884 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a75aeb85-43ca-4e1d-9237-3ea653331747 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.191701 Oct 27 09:43:55.342537 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 515/1038] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:55 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:56.371994 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a07b6bf4-0c24-4e13-a5c6-197d2129b0e5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:56.372739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a07b6bf4-0c24-4e13-a5c6-197d2129b0e5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:56.379142 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a07b6bf4-0c24-4e13-a5c6-197d2129b0e5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:56.379625 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a07b6bf4-0c24-4e13-a5c6-197d2129b0e5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:56.380056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a07b6bf4-0c24-4e13-a5c6-197d2129b0e5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:56.380780 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a07b6bf4-0c24-4e13-a5c6-197d2129b0e5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:56.381234 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a07b6bf4-0c24-4e13-a5c6-197d2129b0e5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:56.381661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a07b6bf4-0c24-4e13-a5c6-197d2129b0e5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:56.524471 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a07b6bf4-0c24-4e13-a5c6-197d2129b0e5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:56.532472 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a07b6bf4-0c24-4e13-a5c6-197d2129b0e5 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.170630 Oct 27 09:43:56.533064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 524/1039] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:56 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:57.556990 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-18824bd4-0200-4201-a9ef-1e5d3810e9ab tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:57.557528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-18824bd4-0200-4201-a9ef-1e5d3810e9ab tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:57.563964 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18824bd4-0200-4201-a9ef-1e5d3810e9ab tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:57.564447 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18824bd4-0200-4201-a9ef-1e5d3810e9ab tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:57.564917 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18824bd4-0200-4201-a9ef-1e5d3810e9ab tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:57.565636 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18824bd4-0200-4201-a9ef-1e5d3810e9ab tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:57.566089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18824bd4-0200-4201-a9ef-1e5d3810e9ab tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:57.566511 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-18824bd4-0200-4201-a9ef-1e5d3810e9ab tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:57.695040 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-18824bd4-0200-4201-a9ef-1e5d3810e9ab tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:57.703145 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-18824bd4-0200-4201-a9ef-1e5d3810e9ab tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.150741 Oct 27 09:43:57.703738 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 516/1040] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:57 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:58.726871 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0c4fe580-7d33-47f7-9881-b04d38b04e3a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:58.727662 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0c4fe580-7d33-47f7-9881-b04d38b04e3a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:58.734967 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0c4fe580-7d33-47f7-9881-b04d38b04e3a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:58.735617 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0c4fe580-7d33-47f7-9881-b04d38b04e3a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:58.736149 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0c4fe580-7d33-47f7-9881-b04d38b04e3a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:58.737135 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0c4fe580-7d33-47f7-9881-b04d38b04e3a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:58.737807 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0c4fe580-7d33-47f7-9881-b04d38b04e3a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:58.738343 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0c4fe580-7d33-47f7-9881-b04d38b04e3a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:58.956885 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-0c4fe580-7d33-47f7-9881-b04d38b04e3a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:43:58.964839 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0c4fe580-7d33-47f7-9881-b04d38b04e3a tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1567 microversion: 2.1 time: 0.241802 Oct 27 09:43:58.965407 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 525/1041] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:58 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:43:59.133120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-758118d6-76d6-4a16-ab3f-8a1c4ae00a6e req-50dd2d59-50cb-4f3d-af83-92f76be8ccd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596c5c1c-3555-40e9-a2d3-6c6300478846", "name": "network-vif-deleted", "tag": "af533890-8a09-4e93-ac93-881cbb38ca23"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:43:59.143052 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-758118d6-76d6-4a16-ab3f-8a1c4ae00a6e req-50dd2d59-50cb-4f3d-af83-92f76be8ccd9 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:59.143538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-758118d6-76d6-4a16-ab3f-8a1c4ae00a6e req-50dd2d59-50cb-4f3d-af83-92f76be8ccd9 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:59.143973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-758118d6-76d6-4a16-ab3f-8a1c4ae00a6e req-50dd2d59-50cb-4f3d-af83-92f76be8ccd9 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:43:59.156079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-758118d6-76d6-4a16-ab3f-8a1c4ae00a6e req-50dd2d59-50cb-4f3d-af83-92f76be8ccd9 service nova] Creating event network-vif-deleted:af533890-8a09-4e93-ac93-881cbb38ca23 for instance 596c5c1c-3555-40e9-a2d3-6c6300478846 on hv-cinder-79797 Oct 27 09:43:59.160751 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-758118d6-76d6-4a16-ab3f-8a1c4ae00a6e req-50dd2d59-50cb-4f3d-af83-92f76be8ccd9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031488 Oct 27 09:43:59.161347 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 517/1042] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:43:59.990065 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:43:59.990698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:43:59.998455 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:43:59.998927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:43:59.999350 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:00.000066 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:00.000592 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:00.001010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:00.035659 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:00.036142 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:00.036930 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:00.037710 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lazy-loading 'fault' on Instance uuid 596c5c1c-3555-40e9-a2d3-6c6300478846 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:44:00.087049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0968b48cb99d4168b36a2602bd87f788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7b8fb656ee34fae8d20679c0e0f7ff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:00.095352 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-3742d43d-531f-4837-866f-e635f19d9a8b tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 200 len: 1179 microversion: 2.1 time: 0.110490 Oct 27 09:44:00.095937 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 526/1043] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:43:59 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 1179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:01.116008 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=4 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:01.121373 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:01.122108 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] [instance: 596c5c1c-3555-40e9-a2d3-6c6300478846] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:01.129045 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:01.129538 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:01.130174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:01.131011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:01.131633 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:01.132044 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:01.154234 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] HTTP exception thrown: Instance 596c5c1c-3555-40e9-a2d3-6c6300478846 could not be found. Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Request method failure captured: Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 HTTP/1.1 Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlGKWLesgC7bNQ3g5x0fhNhdZ4hSp904ZfsfhEWBBEWrs12zwoDFZWhAMs2yPFSukZHANFfNTDuIGw0yEjuKmYONbJXltC45pI-uu4o0BDUy-K3PlxsHxBWcSp3wlBghLwd3VQBa8wxxINdh0bsG0i4miiHap2GnQ9Q-yj1lmkrcCj0 Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: f7b8fb656ee34fae8d20679c0e0f7ff9 Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-TestShelveInstance-1706780009 Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:44:01.157634 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7b8fb656ee34fae8d20679c0e0f7ff9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7b8fb656ee34fae8d20679c0e0f7ff9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7b8fb656ee34fae8d20679c0e0f7ff9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7b8fb656ee34fae8d20679c0e0f7ff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-TestShelveInstance-1706780009 Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: f7b8fb656ee34fae8d20679c0e0f7ff9 Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-TestShelveInstance-1706780009 Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-TestShelveInstance-1706780009-project Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 0968b48cb99d4168b36a2602bd87f788 Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-TestShelveInstance-1706780009-project Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 596c5c1c-3555-40e9-a2d3-6c6300478846 could not be found. Oct 27 09:44:01.159248 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '596c5c1c-3555-40e9-a2d3-6c6300478846'} Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596c5c1c-3555-40e9-a2d3-6c6300478846 could not be found. Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:01.160054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596c5c1c-3555-40e9-a2d3-6c6300478846 could not be found. Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596c5c1c-3555-40e9-a2d3-6c6300478846 could not be found. Oct 27 09:44:01.161760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:01.162889 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Returning 404 to user: Instance 596c5c1c-3555-40e9-a2d3-6c6300478846 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:01.162889 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-090dd538-8a33-4611-8b57-ff5b47580846 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846" status: 404 len: 111 microversion: 2.1 time: 0.044786 Oct 27 09:44:01.162889 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 518/1044] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:01 2022] GET /compute/v2.1/servers/596c5c1c-3555-40e9-a2d3-6c6300478846 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:01.324692 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-58d28603-c932-40f6-a449-b9f8be412bd2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] Calling method '.version_select at 0x7f36492b2d30>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:01.345329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-58d28603-c932-40f6-a449-b9f8be412bd2 tempest-TestShelveInstance-1706780009 tempest-TestShelveInstance-1706780009-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1429495316" status: 202 len: 0 microversion: 2.1 time: 0.025450 Oct 27 09:44:01.346215 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 527/1045] 10.222.0.70 () {58 vars in 1254 bytes} [Thu Oct 27 09:44:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1429495316 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:44:09.452829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1770124448", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1203524332", "security_groups": [{"name": "tempest-secgroup-smoke-375936574"}], "block_device_mapping_v2": [{"uuid": "83b9244c-2f04-47c8-8ae5-77d01cd7bd3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29853958-4339-4761-9164-23edabe04a06"}]}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:09.642676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] validate_networks() for [('29853958-4339-4761-9164-23edabe04a06', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:44:10.047876 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:44:10.048305 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:44:10.048820 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:44:10.049259 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:44:10.049674 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:44:10.059940 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:10.060625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:10.061458 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:10.062643 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:10.063242 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:10.064224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:10.083020 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Getting quotas for project 4ee2066bcc7240f9a63d5c11a2b04a18. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:44:10.087780 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Getting quotas for user 127c4fdd8f2b40ae8d98208d64a7f20d and project 4ee2066bcc7240f9a63d5c11a2b04a18. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:44:10.143511 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:44:10.145675 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='83b9244c-2f04-47c8-8ae5-77d01cd7bd3c',volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:44:10.271627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e579b677-075a-46dd-add9-29d35ccdbb8a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.828283 Oct 27 09:44:10.272618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 519/1046] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:44:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:44:10.281700 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:10.286466 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c42486ef-3c52-4b86-a9ba-9906ed13aed9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:10.287823 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c42486ef-3c52-4b86-a9ba-9906ed13aed9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:10.344944 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c42486ef-3c52-4b86-a9ba-9906ed13aed9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:10.353129 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c42486ef-3c52-4b86-a9ba-9906ed13aed9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1095 microversion: 2.1 time: 0.072392 Oct 27 09:44:10.353710 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 528/1047] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:10 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:11.377594 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9fe71cbe-f6ee-4be6-b2ce-92971ac9246a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:11.378455 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9fe71cbe-f6ee-4be6-b2ce-92971ac9246a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:11.387611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fe71cbe-f6ee-4be6-b2ce-92971ac9246a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:11.388335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fe71cbe-f6ee-4be6-b2ce-92971ac9246a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:11.389023 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fe71cbe-f6ee-4be6-b2ce-92971ac9246a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:11.389812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fe71cbe-f6ee-4be6-b2ce-92971ac9246a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:11.390345 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fe71cbe-f6ee-4be6-b2ce-92971ac9246a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:11.390845 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9fe71cbe-f6ee-4be6-b2ce-92971ac9246a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:11.465543 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9fe71cbe-f6ee-4be6-b2ce-92971ac9246a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:11.475179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9fe71cbe-f6ee-4be6-b2ce-92971ac9246a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1211 microversion: 2.1 time: 0.103631 Oct 27 09:44:11.476324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 520/1048] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:11 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:12.499939 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-36483f28-bef4-47b9-8660-4e86f2cef6bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:12.500611 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-36483f28-bef4-47b9-8660-4e86f2cef6bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:12.507130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36483f28-bef4-47b9-8660-4e86f2cef6bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:12.507686 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36483f28-bef4-47b9-8660-4e86f2cef6bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:12.508123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36483f28-bef4-47b9-8660-4e86f2cef6bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:12.509813 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36483f28-bef4-47b9-8660-4e86f2cef6bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:12.510556 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36483f28-bef4-47b9-8660-4e86f2cef6bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:12.511209 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-36483f28-bef4-47b9-8660-4e86f2cef6bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:12.717500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-36483f28-bef4-47b9-8660-4e86f2cef6bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:12.725023 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-36483f28-bef4-47b9-8660-4e86f2cef6bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.228912 Oct 27 09:44:12.725592 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 529/1049] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:12 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:12.820442 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-22945d57-dd08-4b14-8796-b8d0c7d9bf38 req-f073b882-5fdf-408a-9c26-3aea0566f976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b99fff6-5d91-4648-8384-6a57c8ee57b4", "tag": "ba2ec990-d2bd-49f9-8c22-13fa6afdc1ee"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:12.833335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-22945d57-dd08-4b14-8796-b8d0c7d9bf38 req-f073b882-5fdf-408a-9c26-3aea0566f976 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:12.834079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-22945d57-dd08-4b14-8796-b8d0c7d9bf38 req-f073b882-5fdf-408a-9c26-3aea0566f976 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:12.834283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-22945d57-dd08-4b14-8796-b8d0c7d9bf38 req-f073b882-5fdf-408a-9c26-3aea0566f976 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:12.846772 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-22945d57-dd08-4b14-8796-b8d0c7d9bf38 req-f073b882-5fdf-408a-9c26-3aea0566f976 service nova] Creating event network-changed:ba2ec990-d2bd-49f9-8c22-13fa6afdc1ee for instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 on hv-cinder-79797 Oct 27 09:44:12.851947 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-22945d57-dd08-4b14-8796-b8d0c7d9bf38 req-f073b882-5fdf-408a-9c26-3aea0566f976 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035372 Oct 27 09:44:12.853097 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 521/1050] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:44:13.267845 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9c299804-9a0d-49bd-a500-3dc4c4374b26 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:13.268860 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9c299804-9a0d-49bd-a500-3dc4c4374b26 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:13.277005 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c299804-9a0d-49bd-a500-3dc4c4374b26 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.277564 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c299804-9a0d-49bd-a500-3dc4c4374b26 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.278060 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c299804-9a0d-49bd-a500-3dc4c4374b26 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.278858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c299804-9a0d-49bd-a500-3dc4c4374b26 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.279394 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c299804-9a0d-49bd-a500-3dc4c4374b26 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.279988 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c299804-9a0d-49bd-a500-3dc4c4374b26 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.306059 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9c299804-9a0d-49bd-a500-3dc4c4374b26 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/ips" status: 200 len: 150 microversion: 2.1 time: 0.042430 Oct 27 09:44:13.306559 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 530/1051] 10.222.0.70 () {58 vars in 1248 bytes} [Thu Oct 27 09:44:13 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:13.749263 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fffb0129-fa6d-406f-8157-d24d811a1bcb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:13.749964 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fffb0129-fa6d-406f-8157-d24d811a1bcb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:13.756803 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fffb0129-fa6d-406f-8157-d24d811a1bcb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.757298 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fffb0129-fa6d-406f-8157-d24d811a1bcb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.757746 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fffb0129-fa6d-406f-8157-d24d811a1bcb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.758631 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fffb0129-fa6d-406f-8157-d24d811a1bcb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:13.759282 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fffb0129-fa6d-406f-8157-d24d811a1bcb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:13.759706 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fffb0129-fa6d-406f-8157-d24d811a1bcb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:13.989091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fffb0129-fa6d-406f-8157-d24d811a1bcb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:13.998344 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fffb0129-fa6d-406f-8157-d24d811a1bcb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.253716 Oct 27 09:44:14.008862 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 522/1052] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:13 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:14.152730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-58139ddc-815e-4d79-82d1-7307868bd1e9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:14.155395 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-58139ddc-815e-4d79-82d1-7307868bd1e9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:14.162491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58139ddc-815e-4d79-82d1-7307868bd1e9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:14.163164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58139ddc-815e-4d79-82d1-7307868bd1e9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:14.163618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58139ddc-815e-4d79-82d1-7307868bd1e9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:14.164320 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58139ddc-815e-4d79-82d1-7307868bd1e9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:14.164813 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58139ddc-815e-4d79-82d1-7307868bd1e9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:14.165237 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-58139ddc-815e-4d79-82d1-7307868bd1e9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:14.195411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-58139ddc-815e-4d79-82d1-7307868bd1e9 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048072 Oct 27 09:44:14.196496 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 531/1053] 10.222.0.70 () {60 vars in 1343 bytes} [Thu Oct 27 09:44:14 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:14.263936 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-22a0c12f-f0ee-4005-b134-c9050c74efca tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:14.264374 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-22a0c12f-f0ee-4005-b134-c9050c74efca tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:14.270190 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-22a0c12f-f0ee-4005-b134-c9050c74efca tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:14.270720 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-22a0c12f-f0ee-4005-b134-c9050c74efca tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:14.271148 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-22a0c12f-f0ee-4005-b134-c9050c74efca tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:14.271839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-22a0c12f-f0ee-4005-b134-c9050c74efca tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:14.272342 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-22a0c12f-f0ee-4005-b134-c9050c74efca tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:14.272783 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-22a0c12f-f0ee-4005-b134-c9050c74efca tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:14.298780 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-22a0c12f-f0ee-4005-b134-c9050c74efca tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:44:14.376215 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-22a0c12f-f0ee-4005-b134-c9050c74efca tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 204 len: 0 microversion: 2.20 time: 0.115828 Oct 27 09:44:14.376829 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 523/1054] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Oct 27 09:44:14 2022] DELETE /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 09:44:14.385772 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:14.386387 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:14.392342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:14.392870 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:14.393307 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:14.393992 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:14.394444 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:14.394868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:14.525098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:14.533156 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:14.534600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:14.535786 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1f15b152-efd0-4595-a59e-ca1d87dbfa01 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.154643 Oct 27 09:44:14.536343 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 532/1055] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:44:14 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:44:14.666507 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d625859d-dbc4-4eb6-9e98-9234527ea4de tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05835589-47e6-4000-85ce-dd6da041dbf3"}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:14.669019 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d625859d-dbc4-4eb6-9e98-9234527ea4de tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:14.674961 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d625859d-dbc4-4eb6-9e98-9234527ea4de tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:14.675443 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d625859d-dbc4-4eb6-9e98-9234527ea4de tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:14.675875 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d625859d-dbc4-4eb6-9e98-9234527ea4de tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:14.676598 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d625859d-dbc4-4eb6-9e98-9234527ea4de tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:14.677053 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d625859d-dbc4-4eb6-9e98-9234527ea4de tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:14.677475 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d625859d-dbc4-4eb6-9e98-9234527ea4de tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:15.021605 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-242a26ce-3d7a-4e0d-9228-599ac5f600be tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:15.022221 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-242a26ce-3d7a-4e0d-9228-599ac5f600be tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:15.028160 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-242a26ce-3d7a-4e0d-9228-599ac5f600be tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:15.028674 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-242a26ce-3d7a-4e0d-9228-599ac5f600be tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:15.029115 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-242a26ce-3d7a-4e0d-9228-599ac5f600be tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:15.029802 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-242a26ce-3d7a-4e0d-9228-599ac5f600be tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:15.030260 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-242a26ce-3d7a-4e0d-9228-599ac5f600be tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:15.030687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-242a26ce-3d7a-4e0d-9228-599ac5f600be tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:15.157683 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-242a26ce-3d7a-4e0d-9228-599ac5f600be tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:15.166414 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-242a26ce-3d7a-4e0d-9228-599ac5f600be tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.148766 Oct 27 09:44:15.166978 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 533/1056] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:15 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:15.564414 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d625859d-dbc4-4eb6-9e98-9234527ea4de tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "POST /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901669 Oct 27 09:44:15.564978 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:15.565492 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 524/1057] 10.222.0.70 () {60 vars in 1323 bytes} [Thu Oct 27 09:44:14 2022] POST /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:15.565798 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:15.574580 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:15.575356 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:15.576083 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:15.577130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:15.577929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:15.578602 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:15.767097 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:15.778009 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:15.779618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:15.780844 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1d8967cc-8113-45bf-9cf2-89dee59be7d5 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1720 microversion: 2.20 time: 0.223208 Oct 27 09:44:15.793341 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 534/1058] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:44:15 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:44:16.190461 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-79d6fc76-21aa-4368-a6bd-9ae6fe5879fc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:16.191318 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-79d6fc76-21aa-4368-a6bd-9ae6fe5879fc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:16.200328 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79d6fc76-21aa-4368-a6bd-9ae6fe5879fc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:16.202515 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79d6fc76-21aa-4368-a6bd-9ae6fe5879fc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:16.203281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79d6fc76-21aa-4368-a6bd-9ae6fe5879fc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:16.204309 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79d6fc76-21aa-4368-a6bd-9ae6fe5879fc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:16.204894 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79d6fc76-21aa-4368-a6bd-9ae6fe5879fc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:16.205336 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-79d6fc76-21aa-4368-a6bd-9ae6fe5879fc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:16.482030 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-79d6fc76-21aa-4368-a6bd-9ae6fe5879fc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:16.490910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-79d6fc76-21aa-4368-a6bd-9ae6fe5879fc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.304624 Oct 27 09:44:16.491682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 525/1059] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:16 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:16.808222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:16.808861 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:16.823634 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:16.824363 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:16.824995 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:16.825889 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:16.826338 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:16.826750 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:16.913449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:16.923968 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:16.925794 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2dea51c29cbd46e8bd1454e10eaac012', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7295248456c446bbb3f7d2d5953c9360', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:16.928159 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-82377765-ce03-42a1-a5ba-3c2be7b69a29 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 200 len: 1653 microversion: 2.20 time: 0.124366 Oct 27 09:44:16.929022 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 535/1060] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:44:16 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 1653 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 09:44:16.989304 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-7737359c-1bb7-4af6-8a04-a22008c04325 req-05bb967f-5fdb-4704-856e-4d1c478b4a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a898b1b-5c82-41b1-8b68-0ad30a3516a1", "name": "network-vif-deleted", "tag": "c4193921-efc0-4d0e-8a62-50ecf8de25b1"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:17.000311 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-7737359c-1bb7-4af6-8a04-a22008c04325 req-05bb967f-5fdb-4704-856e-4d1c478b4a94 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:17.000855 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-7737359c-1bb7-4af6-8a04-a22008c04325 req-05bb967f-5fdb-4704-856e-4d1c478b4a94 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:17.001273 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-7737359c-1bb7-4af6-8a04-a22008c04325 req-05bb967f-5fdb-4704-856e-4d1c478b4a94 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:17.019705 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-7737359c-1bb7-4af6-8a04-a22008c04325 req-05bb967f-5fdb-4704-856e-4d1c478b4a94 service nova] Creating event network-vif-deleted:c4193921-efc0-4d0e-8a62-50ecf8de25b1 for instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 on hv-cinder-79797 Oct 27 09:44:17.024901 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-7737359c-1bb7-4af6-8a04-a22008c04325 req-05bb967f-5fdb-4704-856e-4d1c478b4a94 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052991 Oct 27 09:44:17.025587 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 526/1061] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:17.515057 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9abb8586-6751-4034-86d2-f1feb7173971 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:17.515671 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9abb8586-6751-4034-86d2-f1feb7173971 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:17.522223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9abb8586-6751-4034-86d2-f1feb7173971 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:17.522937 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9abb8586-6751-4034-86d2-f1feb7173971 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:17.523556 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9abb8586-6751-4034-86d2-f1feb7173971 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:17.524999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9abb8586-6751-4034-86d2-f1feb7173971 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:17.525601 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9abb8586-6751-4034-86d2-f1feb7173971 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:17.526258 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9abb8586-6751-4034-86d2-f1feb7173971 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:17.680316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9abb8586-6751-4034-86d2-f1feb7173971 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:17.692073 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9abb8586-6751-4034-86d2-f1feb7173971 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.182085 Oct 27 09:44:17.692943 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 536/1062] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:17 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:17.960314 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:17.961272 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:17.968285 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:17.968912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:17.969461 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:17.970244 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:17.970770 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:17.971417 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:17.985119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] HTTP exception thrown: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Request method failure captured: Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 HTTP/1.1 Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEqDAZ0WOPSJQHLbzCfBKonOTdJr4ebFmKuYZxLtASiT0N19OEBmy3Fo5qOTF32fRyiaWgqQc3-vTSqDEM3-aezufEddk4PUlBAx7pt2E5nYzglmBliNG2K0T1OMMJeJs0l56HO5hErbW2w_wjPGla8OXnEkrtQ5YGj-3f24cw9LVU Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:44:17.986886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 2dea51c29cbd46e8bd1454e10eaac012 Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:17.988398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '3a898b1b-5c82-41b1-8b68-0ad30a3516a1'} Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:17.989261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:17.991116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:17.993221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Returning 404 to user: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:17.994227 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a3f0ea69-498f-4200-8695-660e57a74a70 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 404 len: 111 microversion: 2.20 time: 0.041471 Oct 27 09:44:17.995027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 527/1063] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:44:17 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 09:44:18.003641 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d24720d4-2fa2-4338-99e6-dd6a8c9067e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '.version_select at 0x7f3649260160>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:18.024724 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d24720d4-2fa2-4338-99e6-dd6a8c9067e2 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43850174" status: 204 len: 0 microversion: 2.20 time: 0.024742 Oct 27 09:44:18.025833 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 537/1064] 10.222.0.70 () {60 vars in 1256 bytes} [Thu Oct 27 09:44:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43850174 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 09:44:18.719993 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b0d0919c-7078-4481-99c1-98278fded4eb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:18.719993 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b0d0919c-7078-4481-99c1-98278fded4eb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:18.731322 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b0d0919c-7078-4481-99c1-98278fded4eb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:18.732953 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b0d0919c-7078-4481-99c1-98278fded4eb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:18.733754 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b0d0919c-7078-4481-99c1-98278fded4eb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:18.735598 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b0d0919c-7078-4481-99c1-98278fded4eb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:18.736283 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b0d0919c-7078-4481-99c1-98278fded4eb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:18.736803 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b0d0919c-7078-4481-99c1-98278fded4eb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:18.956448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b0d0919c-7078-4481-99c1-98278fded4eb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:18.965607 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b0d0919c-7078-4481-99c1-98278fded4eb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.252137 Oct 27 09:44:18.966188 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 528/1065] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:18 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:19.819201 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:19.819862 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:19.829196 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:19.829965 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:19.830592 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:19.831304 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:19.831992 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:19.832437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:19.847536 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] HTTP exception thrown: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Request method failure captured: Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: DELETE /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 HTTP/1.1 Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEqDAZ0WOPSJQHLbzCfBKonOTdJr4ebFmKuYZxLtASiT0N19OEBmy3Fo5qOTF32fRyiaWgqQc3-vTSqDEM3-aezufEddk4PUlBAx7pt2E5nYzglmBliNG2K0T1OMMJeJs0l56HO5hErbW2w_wjPGla8OXnEkrtQ5YGj-3f24cw9LVU Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:44:19.851991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 2dea51c29cbd46e8bd1454e10eaac012 Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:19.853669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '3a898b1b-5c82-41b1-8b68-0ad30a3516a1'} Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:19.854562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:19.860067 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.863372 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Returning 404 to user: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:19.863372 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-bbf08141-4e9f-457e-b2ea-d67d6be947e7 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 404 len: 111 microversion: 2.20 time: 0.040553 Oct 27 09:44:19.863372 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 538/1066] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Oct 27 09:44:19 2022] DELETE /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:44:19.863973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:19.864642 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 3a898b1b-5c82-41b1-8b68-0ad30a3516a1] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:19.872015 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:19.872642 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:19.873069 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:19.873841 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:19.874372 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:19.874808 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:19.893519 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] HTTP exception thrown: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Request method failure captured: Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 HTTP/1.1 Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlEqDAZ0WOPSJQHLbzCfBKonOTdJr4ebFmKuYZxLtASiT0N19OEBmy3Fo5qOTF32fRyiaWgqQc3-vTSqDEM3-aezufEddk4PUlBAx7pt2E5nYzglmBliNG2K0T1OMMJeJs0l56HO5hErbW2w_wjPGla8OXnEkrtQ5YGj-3f24cw9LVU Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:44:19.895117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 2dea51c29cbd46e8bd1454e10eaac012 Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:19.896753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '3a898b1b-5c82-41b1-8b68-0ad30a3516a1'} Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:19.897648 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. Oct 27 09:44:19.899120 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:19.900407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Returning 404 to user: Instance 3a898b1b-5c82-41b1-8b68-0ad30a3516a1 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:19.900407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-468ed594-7042-451e-a477-04062b54b4b0 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1" status: 404 len: 111 microversion: 2.20 time: 0.037176 Oct 27 09:44:19.900407 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 529/1067] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:44:19 2022] GET /compute/v2.1/servers/3a898b1b-5c82-41b1-8b68-0ad30a3516a1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 09:44:19.988698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-1298e48b-852f-4b8c-b3a4-8fe5fc305219 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:19.989444 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-1298e48b-852f-4b8c-b3a4-8fe5fc305219 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:19.997284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1298e48b-852f-4b8c-b3a4-8fe5fc305219 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:19.997995 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1298e48b-852f-4b8c-b3a4-8fe5fc305219 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:19.998608 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1298e48b-852f-4b8c-b3a4-8fe5fc305219 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:19.999399 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1298e48b-852f-4b8c-b3a4-8fe5fc305219 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:19.999965 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1298e48b-852f-4b8c-b3a4-8fe5fc305219 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:20.000680 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-1298e48b-852f-4b8c-b3a4-8fe5fc305219 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:20.140620 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-1298e48b-852f-4b8c-b3a4-8fe5fc305219 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:20.148167 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-1298e48b-852f-4b8c-b3a4-8fe5fc305219 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.163627 Oct 27 09:44:20.148760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 539/1068] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:19 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:21.007553 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1118336327", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "networks": [{"uuid": "044dd9bc-8607-4d16-b4ca-805b7d777203"}]}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:21.016852 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:21.017535 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=6 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:21.018223 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:21.047096 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:21.047668 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:21.049652 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:21.055351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.056306 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.056306 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.056984 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.057436 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.057925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.066932 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] validate_networks() for [('044dd9bc-8607-4d16-b4ca-805b7d777203', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:44:21.072618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] HTTP exception thrown: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Request method failure captured: Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: DELETE /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 HTTP/1.1 Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEqDAZ0WOPSJQHLbzCfBKonOTdJr4ebFmKuYZxLtASiT0N19OEBmy3Fo5qOTF32fRyiaWgqQc3-vTSqDEM3-aezufEddk4PUlBAx7pt2E5nYzglmBliNG2K0T1OMMJeJs0l56HO5hErbW2w_wjPGla8OXnEkrtQ5YGj-3f24cw9LVU Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:44:21.074418 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 2dea51c29cbd46e8bd1454e10eaac012 Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:44:21.076039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '8ac6a130-38c4-4843-b9a8-118d25c11c18'} Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:21.076910 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:44:21.078324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:21.079698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Returning 404 to user: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:21.079698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4142856d-608d-4588-82e6-0289cc3bf04b tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 404 len: 111 microversion: 2.20 time: 0.032609 Oct 27 09:44:21.079698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 540/1069] 10.222.0.70 () {60 vars in 1280 bytes} [Thu Oct 27 09:44:21 2022] DELETE /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 09:44:21.083682 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:21.084276 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] [instance: 8ac6a130-38c4-4843-b9a8-118d25c11c18] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:21.090751 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.091232 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.091661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.092344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.092818 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.093236 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.106739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] HTTP exception thrown: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Request method failure captured: Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 HTTP/1.1 Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlEqDAZ0WOPSJQHLbzCfBKonOTdJr4ebFmKuYZxLtASiT0N19OEBmy3Fo5qOTF32fRyiaWgqQc3-vTSqDEM3-aezufEddk4PUlBAx7pt2E5nYzglmBliNG2K0T1OMMJeJs0l56HO5hErbW2w_wjPGla8OXnEkrtQ5YGj-3f24cw9LVU Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:44:21.108290 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7295248456c446bbb3f7d2d5953c9360"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 7295248456c446bbb3f7d2d5953c9360 Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2051091653 Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 2dea51c29cbd46e8bd1454e10eaac012 Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2051091653-project Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:44:21.109902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '8ac6a130-38c4-4843-b9a8-118d25c11c18'} Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:21.111010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. Oct 27 09:44:21.112462 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:21.113953 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] Returning 404 to user: Instance 8ac6a130-38c4-4843-b9a8-118d25c11c18 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:21.113953 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-5389dc30-d7c3-4982-b4b7-7836ec82caf1 tempest-AttachVolumeShelveTestJSON-2051091653 tempest-AttachVolumeShelveTestJSON-2051091653-project] 10.222.0.70 "GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18" status: 404 len: 111 microversion: 2.20 time: 0.029548 Oct 27 09:44:21.113953 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 541/1070] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Oct 27 09:44:21 2022] GET /compute/v2.1/servers/8ac6a130-38c4-4843-b9a8-118d25c11c18 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 09:44:21.171608 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cb07df7a-31c2-4cf2-bcab-4a31b858f199 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:21.172432 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cb07df7a-31c2-4cf2-bcab-4a31b858f199 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:21.179512 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb07df7a-31c2-4cf2-bcab-4a31b858f199 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.180029 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb07df7a-31c2-4cf2-bcab-4a31b858f199 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.180736 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb07df7a-31c2-4cf2-bcab-4a31b858f199 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.181611 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb07df7a-31c2-4cf2-bcab-4a31b858f199 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.182071 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb07df7a-31c2-4cf2-bcab-4a31b858f199 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.182499 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cb07df7a-31c2-4cf2-bcab-4a31b858f199 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.414503 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-cb07df7a-31c2-4cf2-bcab-4a31b858f199 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:21.425397 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cb07df7a-31c2-4cf2-bcab-4a31b858f199 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.257810 Oct 27 09:44:21.425890 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 542/1071] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:21 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:21.511087 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:44:21.511516 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:44:21.511992 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:44:21.512409 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:44:21.512850 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:44:21.521823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.522308 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.522753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.523489 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:21.523954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:21.524382 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:21.531049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:21.543289 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Getting quotas for project f5b8d4a1ce084cc6b3e84ebb7778e5ae. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:44:21.547854 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Getting quotas for user 52ac2b5469904e4a8a742de14fcc8508 and project f5b8d4a1ce084cc6b3e84ebb7778e5ae. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:44:21.559867 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:44:21.562265 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:44:21.611305 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-04a72677-83d2-4b65-a60d-e949e66fe122 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607513 Oct 27 09:44:21.611960 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 530/1072] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:44:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:44:21.623678 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-37ea4d8f-399b-42ad-8d08-d74650e4379e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:21.624292 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-37ea4d8f-399b-42ad-8d08-d74650e4379e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:21.686255 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-37ea4d8f-399b-42ad-8d08-d74650e4379e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:21.696786 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-37ea4d8f-399b-42ad-8d08-d74650e4379e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1214 microversion: 2.1 time: 0.076840 Oct 27 09:44:21.697519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 543/1073] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:21 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:22.327114 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ad3885b5-1535-4d1d-a20c-db163d8c196a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:22.328338 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ad3885b5-1535-4d1d-a20c-db163d8c196a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:22.335756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad3885b5-1535-4d1d-a20c-db163d8c196a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.336629 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad3885b5-1535-4d1d-a20c-db163d8c196a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.337316 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad3885b5-1535-4d1d-a20c-db163d8c196a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.338261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad3885b5-1535-4d1d-a20c-db163d8c196a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.338839 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad3885b5-1535-4d1d-a20c-db163d8c196a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.339374 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ad3885b5-1535-4d1d-a20c-db163d8c196a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.449488 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-88d2ab29-f143-46e2-b2da-2e36db8f1dbb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:22.451695 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-88d2ab29-f143-46e2-b2da-2e36db8f1dbb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:22.460370 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88d2ab29-f143-46e2-b2da-2e36db8f1dbb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.461195 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88d2ab29-f143-46e2-b2da-2e36db8f1dbb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.461796 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88d2ab29-f143-46e2-b2da-2e36db8f1dbb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.462922 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88d2ab29-f143-46e2-b2da-2e36db8f1dbb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.463852 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88d2ab29-f143-46e2-b2da-2e36db8f1dbb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.464431 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-88d2ab29-f143-46e2-b2da-2e36db8f1dbb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.481519 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-ad3885b5-1535-4d1d-a20c-db163d8c196a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lazy-loading 'services' on Instance uuid fc6d582c-7b11-474d-ade0-762c6ccee705 {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:44:22.605808 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ad3885b5-1535-4d1d-a20c-db163d8c196a tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/os-volume_attachments/05835589-47e6-4000-85ce-dd6da041dbf3" status: 202 len: 0 microversion: 2.1 time: 0.282638 Oct 27 09:44:22.607328 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 531/1074] 10.222.0.70 () {58 vars in 1416 bytes} [Thu Oct 27 09:44:22 2022] DELETE /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/os-volume_attachments/05835589-47e6-4000-85ce-dd6da041dbf3 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:44:22.619402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-245440ae-776d-4641-82fa-553814d94057 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:22.622753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-245440ae-776d-4641-82fa-553814d94057 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:22.631633 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-245440ae-776d-4641-82fa-553814d94057 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.632367 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-245440ae-776d-4641-82fa-553814d94057 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.632995 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-245440ae-776d-4641-82fa-553814d94057 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.634034 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-245440ae-776d-4641-82fa-553814d94057 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.634639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-245440ae-776d-4641-82fa-553814d94057 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.635848 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-245440ae-776d-4641-82fa-553814d94057 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.671010 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-245440ae-776d-4641-82fa-553814d94057 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058269 Oct 27 09:44:22.671904 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 532/1075] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:44:22 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:44:22.677857 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-88d2ab29-f143-46e2-b2da-2e36db8f1dbb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:22.686756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-88d2ab29-f143-46e2-b2da-2e36db8f1dbb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.242025 Oct 27 09:44:22.687926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 544/1076] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:22 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:22.721429 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-99b64919-8d09-440b-9d74-c5a0ed2cf486 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:22.722004 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-99b64919-8d09-440b-9d74-c5a0ed2cf486 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:22.729376 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99b64919-8d09-440b-9d74-c5a0ed2cf486 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.730178 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99b64919-8d09-440b-9d74-c5a0ed2cf486 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.730632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99b64919-8d09-440b-9d74-c5a0ed2cf486 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.731385 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99b64919-8d09-440b-9d74-c5a0ed2cf486 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:22.732005 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99b64919-8d09-440b-9d74-c5a0ed2cf486 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:22.732632 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99b64919-8d09-440b-9d74-c5a0ed2cf486 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:22.815685 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-99b64919-8d09-440b-9d74-c5a0ed2cf486 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:22.828786 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-99b64919-8d09-440b-9d74-c5a0ed2cf486 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1266 microversion: 2.1 time: 0.111107 Oct 27 09:44:22.829823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 533/1077] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:22 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:23.684558 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0f38e8d6-ff78-4fe1-8b97-6043ded91092 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:23.686827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0f38e8d6-ff78-4fe1-8b97-6043ded91092 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:23.693406 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f38e8d6-ff78-4fe1-8b97-6043ded91092 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:23.693886 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f38e8d6-ff78-4fe1-8b97-6043ded91092 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:23.694373 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f38e8d6-ff78-4fe1-8b97-6043ded91092 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.695077 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f38e8d6-ff78-4fe1-8b97-6043ded91092 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:23.695569 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f38e8d6-ff78-4fe1-8b97-6043ded91092 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:23.696536 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0f38e8d6-ff78-4fe1-8b97-6043ded91092 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.711421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-81fa408c-d741-4a84-842c-a88fd9e61921 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:23.714076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-81fa408c-d741-4a84-842c-a88fd9e61921 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:23.721491 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81fa408c-d741-4a84-842c-a88fd9e61921 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:23.723500 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81fa408c-d741-4a84-842c-a88fd9e61921 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:23.723954 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81fa408c-d741-4a84-842c-a88fd9e61921 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.724841 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81fa408c-d741-4a84-842c-a88fd9e61921 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:23.725498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81fa408c-d741-4a84-842c-a88fd9e61921 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:23.726087 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-81fa408c-d741-4a84-842c-a88fd9e61921 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.728270 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0f38e8d6-ff78-4fe1-8b97-6043ded91092 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048249 Oct 27 09:44:23.728999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 545/1078] 10.222.0.70 () {58 vars in 1302 bytes} [Thu Oct 27 09:44:23 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 09:44:23.798020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-80428877-9fc5-4c11-a9d3-ee7d43e672f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:23.798678 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-80428877-9fc5-4c11-a9d3-ee7d43e672f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:23.805021 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80428877-9fc5-4c11-a9d3-ee7d43e672f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:23.805760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80428877-9fc5-4c11-a9d3-ee7d43e672f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:23.806302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80428877-9fc5-4c11-a9d3-ee7d43e672f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.807145 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80428877-9fc5-4c11-a9d3-ee7d43e672f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:23.807707 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80428877-9fc5-4c11-a9d3-ee7d43e672f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:23.808357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-80428877-9fc5-4c11-a9d3-ee7d43e672f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.835924 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-80428877-9fc5-4c11-a9d3-ee7d43e672f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Going to try to terminate instance {{(pid=125361) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:44:23.936174 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-80428877-9fc5-4c11-a9d3-ee7d43e672f6 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 204 len: 0 microversion: 2.1 time: 0.141238 Oct 27 09:44:23.937515 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 546/1079] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:23 2022] DELETE /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:44:23.949094 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a68b449c-b53f-4533-8ac2-9001dc186aee tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:23.950168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a68b449c-b53f-4533-8ac2-9001dc186aee tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:23.956450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a68b449c-b53f-4533-8ac2-9001dc186aee tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:23.957033 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a68b449c-b53f-4533-8ac2-9001dc186aee tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:23.957635 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a68b449c-b53f-4533-8ac2-9001dc186aee tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.958501 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a68b449c-b53f-4533-8ac2-9001dc186aee tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:23.959118 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a68b449c-b53f-4533-8ac2-9001dc186aee tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:23.959761 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a68b449c-b53f-4533-8ac2-9001dc186aee tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:23.960284 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-81fa408c-d741-4a84-842c-a88fd9e61921 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:23.993314 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-81fa408c-d741-4a84-842c-a88fd9e61921 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.286269 Oct 27 09:44:24.012644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 534/1080] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:23 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:24.029513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-67690695-f538-44c6-8342-ce3afd65aad8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:24.030495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-67690695-f538-44c6-8342-ce3afd65aad8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:24.057112 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67690695-f538-44c6-8342-ce3afd65aad8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:24.058054 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67690695-f538-44c6-8342-ce3afd65aad8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:24.058737 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67690695-f538-44c6-8342-ce3afd65aad8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:24.061098 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67690695-f538-44c6-8342-ce3afd65aad8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:24.061987 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67690695-f538-44c6-8342-ce3afd65aad8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:24.063868 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-67690695-f538-44c6-8342-ce3afd65aad8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:24.358173 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-67690695-f538-44c6-8342-ce3afd65aad8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:24.373193 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-67690695-f538-44c6-8342-ce3afd65aad8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1681 microversion: 2.1 time: 0.358896 Oct 27 09:44:24.373834 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 535/1081] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:24 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1681 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:24.378961 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-4fb42f3e-86fd-4b11-89da-e8523e3a4108 req-75ec7134-3198-4aa0-b643-85a81119b920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b99fff6-5d91-4648-8384-6a57c8ee57b4", "name": "network-vif-plugged", "status": "completed", "tag": "ba2ec990-d2bd-49f9-8c22-13fa6afdc1ee"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:24.388581 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a68b449c-b53f-4533-8ac2-9001dc186aee tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:24.395509 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-4fb42f3e-86fd-4b11-89da-e8523e3a4108 req-75ec7134-3198-4aa0-b643-85a81119b920 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:24.395986 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-4fb42f3e-86fd-4b11-89da-e8523e3a4108 req-75ec7134-3198-4aa0-b643-85a81119b920 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:24.396480 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-4fb42f3e-86fd-4b11-89da-e8523e3a4108 req-75ec7134-3198-4aa0-b643-85a81119b920 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:24.396692 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a68b449c-b53f-4533-8ac2-9001dc186aee tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1314 microversion: 2.1 time: 0.454271 Oct 27 09:44:24.397440 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 547/1082] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:23 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:24.408200 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-4fb42f3e-86fd-4b11-89da-e8523e3a4108 req-75ec7134-3198-4aa0-b643-85a81119b920 service nova] Creating event network-vif-plugged:ba2ec990-d2bd-49f9-8c22-13fa6afdc1ee for instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 on hv-cinder-79797 Oct 27 09:44:24.413329 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-4fb42f3e-86fd-4b11-89da-e8523e3a4108 req-75ec7134-3198-4aa0-b643-85a81119b920 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038028 Oct 27 09:44:24.413917 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 536/1083] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:25.018442 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-95980cbe-00f5-4e34-9758-e65c11a0ccd7 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:25.019087 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-95980cbe-00f5-4e34-9758-e65c11a0ccd7 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:25.026018 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95980cbe-00f5-4e34-9758-e65c11a0ccd7 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:25.026504 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95980cbe-00f5-4e34-9758-e65c11a0ccd7 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:25.026948 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95980cbe-00f5-4e34-9758-e65c11a0ccd7 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:25.027646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95980cbe-00f5-4e34-9758-e65c11a0ccd7 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:25.028105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95980cbe-00f5-4e34-9758-e65c11a0ccd7 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:25.028548 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-95980cbe-00f5-4e34-9758-e65c11a0ccd7 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:25.032669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:25.205569 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-95980cbe-00f5-4e34-9758-e65c11a0ccd7 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:25.214316 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-95980cbe-00f5-4e34-9758-e65c11a0ccd7 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.199703 Oct 27 09:44:25.214898 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 548/1084] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:25 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:25.398063 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7d580f80-8ee9-4653-9325-f0e1d9d8daba tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:25.399498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7d580f80-8ee9-4653-9325-f0e1d9d8daba tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:25.405811 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d580f80-8ee9-4653-9325-f0e1d9d8daba tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:25.406402 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d580f80-8ee9-4653-9325-f0e1d9d8daba tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:25.407082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d580f80-8ee9-4653-9325-f0e1d9d8daba tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:25.407984 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d580f80-8ee9-4653-9325-f0e1d9d8daba tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:25.408741 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d580f80-8ee9-4653-9325-f0e1d9d8daba tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:25.409399 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7d580f80-8ee9-4653-9325-f0e1d9d8daba tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:25.419185 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-dc9407d1-0da6-40e8-9617-d066973458de tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:25.420489 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-dc9407d1-0da6-40e8-9617-d066973458de tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:25.423763 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:25.430773 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dc9407d1-0da6-40e8-9617-d066973458de tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:25.432026 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dc9407d1-0da6-40e8-9617-d066973458de tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:25.432874 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dc9407d1-0da6-40e8-9617-d066973458de tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:25.435642 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dc9407d1-0da6-40e8-9617-d066973458de tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:25.436619 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dc9407d1-0da6-40e8-9617-d066973458de tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:25.437248 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-dc9407d1-0da6-40e8-9617-d066973458de tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:25.718065 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7d580f80-8ee9-4653-9325-f0e1d9d8daba tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:25.726572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7d580f80-8ee9-4653-9325-f0e1d9d8daba tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1681 microversion: 2.1 time: 0.333226 Oct 27 09:44:25.732814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 537/1085] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:25 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1681 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:25.752699 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-dc9407d1-0da6-40e8-9617-d066973458de tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:25.761824 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-dc9407d1-0da6-40e8-9617-d066973458de tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1314 microversion: 2.1 time: 0.346372 Oct 27 09:44:25.762724 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 549/1086] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:25 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:26.238514 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b9b174cb-d30d-407b-a925-c24203f4f1d4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:26.239126 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b9b174cb-d30d-407b-a925-c24203f4f1d4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:26.245876 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9b174cb-d30d-407b-a925-c24203f4f1d4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.246375 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9b174cb-d30d-407b-a925-c24203f4f1d4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.246818 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9b174cb-d30d-407b-a925-c24203f4f1d4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.247529 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9b174cb-d30d-407b-a925-c24203f4f1d4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.247991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9b174cb-d30d-407b-a925-c24203f4f1d4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.248421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b9b174cb-d30d-407b-a925-c24203f4f1d4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.715531 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-338c4806-418a-4af2-ac1d-122efd0ba0d3 req-0c2ead37-2ac4-40aa-b241-5ae50715ca46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e25ffb07-4fd4-4f81-9b29-40b0d136dabc", "tag": "25fbbbb1-f199-4497-bbdc-ad9bbf5dc18f"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:26.728308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-338c4806-418a-4af2-ac1d-122efd0ba0d3 req-0c2ead37-2ac4-40aa-b241-5ae50715ca46 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.729354 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-338c4806-418a-4af2-ac1d-122efd0ba0d3 req-0c2ead37-2ac4-40aa-b241-5ae50715ca46 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.729963 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-338c4806-418a-4af2-ac1d-122efd0ba0d3 req-0c2ead37-2ac4-40aa-b241-5ae50715ca46 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.741747 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-338c4806-418a-4af2-ac1d-122efd0ba0d3 req-0c2ead37-2ac4-40aa-b241-5ae50715ca46 service nova] Creating event network-changed:25fbbbb1-f199-4497-bbdc-ad9bbf5dc18f for instance e25ffb07-4fd4-4f81-9b29-40b0d136dabc on hv-cinder-79797 Oct 27 09:44:26.749212 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-338c4806-418a-4af2-ac1d-122efd0ba0d3 req-0c2ead37-2ac4-40aa-b241-5ae50715ca46 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038712 Oct 27 09:44:26.750488 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 550/1087] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:26.757610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-bb29b390-de5d-4db0-bb19-020c560d57d8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:26.759517 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-bb29b390-de5d-4db0-bb19-020c560d57d8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:26.768579 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb29b390-de5d-4db0-bb19-020c560d57d8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.769371 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb29b390-de5d-4db0-bb19-020c560d57d8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.769969 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb29b390-de5d-4db0-bb19-020c560d57d8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.770958 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb29b390-de5d-4db0-bb19-020c560d57d8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.771577 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb29b390-de5d-4db0-bb19-020c560d57d8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.772150 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-bb29b390-de5d-4db0-bb19-020c560d57d8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.787397 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b9b174cb-d30d-407b-a925-c24203f4f1d4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:26.801818 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b9b174cb-d30d-407b-a925-c24203f4f1d4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1266 microversion: 2.1 time: 0.567114 Oct 27 09:44:26.816627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 538/1088] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:26 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1266 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:26.816627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c4d96078-20fc-4037-b9e9-18707364b031 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:26.816627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c4d96078-20fc-4037-b9e9-18707364b031 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:26.816627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4d96078-20fc-4037-b9e9-18707364b031 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.817126 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4d96078-20fc-4037-b9e9-18707364b031 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.818270 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4d96078-20fc-4037-b9e9-18707364b031 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:26.819079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4d96078-20fc-4037-b9e9-18707364b031 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:26.819603 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4d96078-20fc-4037-b9e9-18707364b031 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:26.820076 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c4d96078-20fc-4037-b9e9-18707364b031 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:27.230105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-bb29b390-de5d-4db0-bb19-020c560d57d8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:27.238230 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-bb29b390-de5d-4db0-bb19-020c560d57d8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1681 microversion: 2.1 time: 0.486408 Oct 27 09:44:27.238808 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 551/1089] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:26 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1681 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:27.239624 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c4d96078-20fc-4037-b9e9-18707364b031 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:27.248443 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c4d96078-20fc-4037-b9e9-18707364b031 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1314 microversion: 2.1 time: 0.444156 Oct 27 09:44:27.249115 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 539/1090] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:26 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:27.830819 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-109d7667-18db-4707-bc67-ac89b5d23b5b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:27.832560 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-109d7667-18db-4707-bc67-ac89b5d23b5b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:27.840062 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-109d7667-18db-4707-bc67-ac89b5d23b5b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:27.840643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-109d7667-18db-4707-bc67-ac89b5d23b5b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:27.841134 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-109d7667-18db-4707-bc67-ac89b5d23b5b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:27.842368 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-109d7667-18db-4707-bc67-ac89b5d23b5b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:27.843079 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-109d7667-18db-4707-bc67-ac89b5d23b5b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:27.843701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-109d7667-18db-4707-bc67-ac89b5d23b5b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:27.994030 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-109d7667-18db-4707-bc67-ac89b5d23b5b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:28.002187 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-109d7667-18db-4707-bc67-ac89b5d23b5b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1452 microversion: 2.1 time: 0.175173 Oct 27 09:44:28.002760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 552/1091] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:27 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:28.024853 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1a9b969c-294e-4bf3-a041-ccd7a9f18653 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:28.025494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1a9b969c-294e-4bf3-a041-ccd7a9f18653 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:28.031938 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a9b969c-294e-4bf3-a041-ccd7a9f18653 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.032420 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a9b969c-294e-4bf3-a041-ccd7a9f18653 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.032886 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a9b969c-294e-4bf3-a041-ccd7a9f18653 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.033578 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a9b969c-294e-4bf3-a041-ccd7a9f18653 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.034031 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a9b969c-294e-4bf3-a041-ccd7a9f18653 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.034452 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1a9b969c-294e-4bf3-a041-ccd7a9f18653 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.183461 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1a9b969c-294e-4bf3-a041-ccd7a9f18653 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:28.191857 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1a9b969c-294e-4bf3-a041-ccd7a9f18653 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1452 microversion: 2.1 time: 0.171371 Oct 27 09:44:28.193089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 540/1092] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:28 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:28.261935 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:28.262539 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:28.275146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ed09f2cf-84af-45f7-a6dd-09c094e95575 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:28.276386 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ed09f2cf-84af-45f7-a6dd-09c094e95575 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:28.277742 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.278246 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.278681 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.285279 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.286004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.286623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.290237 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed09f2cf-84af-45f7-a6dd-09c094e95575 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.290734 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed09f2cf-84af-45f7-a6dd-09c094e95575 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.291174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed09f2cf-84af-45f7-a6dd-09c094e95575 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.293561 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed09f2cf-84af-45f7-a6dd-09c094e95575 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.294037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed09f2cf-84af-45f7-a6dd-09c094e95575 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.294477 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ed09f2cf-84af-45f7-a6dd-09c094e95575 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.323264 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.324065 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.324688 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.325288 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.objects.instance [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lazy-loading 'fault' on Instance uuid fc6d582c-7b11-474d-ade0-762c6ccee705 {{(pid=125361) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:44:28.381897 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7d2c6275669404db608d714baeb0065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df84eaa566a24d3e8d25c1065e8c09fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:28.392691 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-75d6eb6e-9668-4d5a-bb74-1c20c1ea9365 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 200 len: 1330 microversion: 2.1 time: 0.134410 Oct 27 09:44:28.397434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 553/1093] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:28 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 1330 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:28.526927 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ed09f2cf-84af-45f7-a6dd-09c094e95575 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:28.535747 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ed09f2cf-84af-45f7-a6dd-09c094e95575 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1314 microversion: 2.1 time: 0.268400 Oct 27 09:44:28.542621 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 541/1094] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:28 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:28.771748 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-7a0a1493-c2e7-4517-8bdc-b7c3efdf31c6 req-fa519733-ab16-4c34-9f1c-66098cab9ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc6d582c-7b11-474d-ade0-762c6ccee705", "name": "network-vif-deleted", "tag": "345288e1-68e9-44e4-b75d-e117a08b1f49"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:28.783772 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-7a0a1493-c2e7-4517-8bdc-b7c3efdf31c6 req-fa519733-ab16-4c34-9f1c-66098cab9ce6 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:28.784456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-7a0a1493-c2e7-4517-8bdc-b7c3efdf31c6 req-fa519733-ab16-4c34-9f1c-66098cab9ce6 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:28.784998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-7a0a1493-c2e7-4517-8bdc-b7c3efdf31c6 req-fa519733-ab16-4c34-9f1c-66098cab9ce6 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:28.802148 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-7a0a1493-c2e7-4517-8bdc-b7c3efdf31c6 req-fa519733-ab16-4c34-9f1c-66098cab9ce6 service nova] Creating event network-vif-deleted:345288e1-68e9-44e4-b75d-e117a08b1f49 for instance fc6d582c-7b11-474d-ade0-762c6ccee705 on hv-cinder-79797 Oct 27 09:44:28.807235 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-7a0a1493-c2e7-4517-8bdc-b7c3efdf31c6 req-fa519733-ab16-4c34-9f1c-66098cab9ce6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039248 Oct 27 09:44:28.808045 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 554/1095] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:29.420480 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:29.421123 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:29.427476 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:29.427961 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:29.428398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:29.429123 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:29.429581 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:29.430007 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:29.443560 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 HTTP/1.1 Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:44:29.445813 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:29.447410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': 'fc6d582c-7b11-474d-ade0-762c6ccee705'} Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:29.448506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:29.450157 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:29.451807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:29.451807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d9d5f9a8-2e68-4a59-8397-d97cf331f660 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 404 len: 111 microversion: 2.1 time: 0.030773 Oct 27 09:44:29.451807 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 542/1096] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:29 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:29.458291 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-25127d9d-ab6b-4f6b-b986-231e3f19b31c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '.version_select at 0x7f36491ab5e0>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:29.476450 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-25127d9d-ab6b-4f6b-b986-231e3f19b31c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-834887002" status: 202 len: 0 microversion: 2.1 time: 0.023274 Oct 27 09:44:29.477155 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 555/1097] 10.222.0.70 () {58 vars in 1218 bytes} [Thu Oct 27 09:44:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-834887002 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 09:44:29.559495 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-11f41641-3e74-40b2-af8b-58acfc742d06 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:29.560319 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-11f41641-3e74-40b2-af8b-58acfc742d06 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:29.566872 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-11f41641-3e74-40b2-af8b-58acfc742d06 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:29.567499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-11f41641-3e74-40b2-af8b-58acfc742d06 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:29.568060 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-11f41641-3e74-40b2-af8b-58acfc742d06 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:29.568898 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-11f41641-3e74-40b2-af8b-58acfc742d06 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:29.569540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-11f41641-3e74-40b2-af8b-58acfc742d06 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:29.570027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-11f41641-3e74-40b2-af8b-58acfc742d06 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:29.830167 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-11f41641-3e74-40b2-af8b-58acfc742d06 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:29.838551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-11f41641-3e74-40b2-af8b-58acfc742d06 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1314 microversion: 2.1 time: 0.284367 Oct 27 09:44:29.839225 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 543/1098] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:29 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:30.205547 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-00014a3c-10c7-45ec-86c2-3d1106545bef req-aa11c605-1562-4c7d-a3ea-bd1347fa96a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b99fff6-5d91-4648-8384-6a57c8ee57b4", "tag": "ba2ec990-d2bd-49f9-8c22-13fa6afdc1ee"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:30.220475 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-00014a3c-10c7-45ec-86c2-3d1106545bef req-aa11c605-1562-4c7d-a3ea-bd1347fa96a0 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:30.221329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-00014a3c-10c7-45ec-86c2-3d1106545bef req-aa11c605-1562-4c7d-a3ea-bd1347fa96a0 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:30.222568 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-00014a3c-10c7-45ec-86c2-3d1106545bef req-aa11c605-1562-4c7d-a3ea-bd1347fa96a0 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:30.240579 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-00014a3c-10c7-45ec-86c2-3d1106545bef req-aa11c605-1562-4c7d-a3ea-bd1347fa96a0 service nova] Creating event network-changed:ba2ec990-d2bd-49f9-8c22-13fa6afdc1ee for instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 on hv-cinder-79797 Oct 27 09:44:30.250129 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-00014a3c-10c7-45ec-86c2-3d1106545bef req-aa11c605-1562-4c7d-a3ea-bd1347fa96a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050371 Oct 27 09:44:30.250976 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 556/1099] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:30.863186 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ae27649b-a75e-4e33-82dd-6ccc890e4a61 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:30.863824 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ae27649b-a75e-4e33-82dd-6ccc890e4a61 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:30.871448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ae27649b-a75e-4e33-82dd-6ccc890e4a61 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:30.871448 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ae27649b-a75e-4e33-82dd-6ccc890e4a61 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:30.872027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ae27649b-a75e-4e33-82dd-6ccc890e4a61 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:30.872835 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ae27649b-a75e-4e33-82dd-6ccc890e4a61 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:30.873365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ae27649b-a75e-4e33-82dd-6ccc890e4a61 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:30.873896 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ae27649b-a75e-4e33-82dd-6ccc890e4a61 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:31.007592 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ae27649b-a75e-4e33-82dd-6ccc890e4a61 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:31.015918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ae27649b-a75e-4e33-82dd-6ccc890e4a61 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1314 microversion: 2.1 time: 0.156621 Oct 27 09:44:31.016488 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 544/1100] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:30 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:31.445336 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:31.445928 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:31.452552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:31.453032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:31.453466 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:31.454161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:31.454815 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:31.455238 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:31.469340 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: DELETE /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 HTTP/1.1 Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:44:31.471302 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:31.472863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': 'fc6d582c-7b11-474d-ade0-762c6ccee705'} Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:31.473787 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:31.475182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:31.478223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:31.478223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b1f7895d-f80d-44e7-85c2-3599f96f2c9d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 404 len: 111 microversion: 2.1 time: 0.032173 Oct 27 09:44:31.478223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 557/1101] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:31 2022] DELETE /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:31.482487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:31.483096 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: fc6d582c-7b11-474d-ade0-762c6ccee705] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:31.489192 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:31.489682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:31.490123 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:31.491131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:31.491756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:31.492945 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:31.509361 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 HTTP/1.1 Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:44:31.511528 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:31.513138 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': 'fc6d582c-7b11-474d-ade0-762c6ccee705'} Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:31.514174 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. Oct 27 09:44:31.515599 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:31.517205 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance fc6d582c-7b11-474d-ade0-762c6ccee705 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:31.517205 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8bc59158-c0a2-4dac-9069-af7bb89f1fa2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705" status: 404 len: 111 microversion: 2.1 time: 0.034684 Oct 27 09:44:31.517205 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 545/1102] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:31 2022] GET /compute/v2.1/servers/fc6d582c-7b11-474d-ade0-762c6ccee705 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:32.039562 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-46170f47-6447-4e3c-8d27-fefc391e8148 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:32.040187 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-46170f47-6447-4e3c-8d27-fefc391e8148 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:32.042178 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:32.047514 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-46170f47-6447-4e3c-8d27-fefc391e8148 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:32.047993 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-46170f47-6447-4e3c-8d27-fefc391e8148 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:32.048420 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-46170f47-6447-4e3c-8d27-fefc391e8148 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:32.049133 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-46170f47-6447-4e3c-8d27-fefc391e8148 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:32.049591 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-46170f47-6447-4e3c-8d27-fefc391e8148 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:32.050013 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-46170f47-6447-4e3c-8d27-fefc391e8148 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:32.183020 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-46170f47-6447-4e3c-8d27-fefc391e8148 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:32.190554 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-46170f47-6447-4e3c-8d27-fefc391e8148 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1314 microversion: 2.1 time: 0.155452 Oct 27 09:44:32.191110 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 558/1103] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:32 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:33.213953 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-9ce1d6b7-635e-435b-bbb2-b5a9fcadd81a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:33.214568 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-9ce1d6b7-635e-435b-bbb2-b5a9fcadd81a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:33.216585 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:33.217224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=6 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:33.224025 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9ce1d6b7-635e-435b-bbb2-b5a9fcadd81a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.224511 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9ce1d6b7-635e-435b-bbb2-b5a9fcadd81a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.224975 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9ce1d6b7-635e-435b-bbb2-b5a9fcadd81a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.225669 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9ce1d6b7-635e-435b-bbb2-b5a9fcadd81a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.226124 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9ce1d6b7-635e-435b-bbb2-b5a9fcadd81a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.226548 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-9ce1d6b7-635e-435b-bbb2-b5a9fcadd81a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.354644 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-9ce1d6b7-635e-435b-bbb2-b5a9fcadd81a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:33.362503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-9ce1d6b7-635e-435b-bbb2-b5a9fcadd81a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1314 microversion: 2.1 time: 0.153032 Oct 27 09:44:33.363095 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 546/1104] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:33 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:33.637491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-a82f35b6-00d0-4b97-9522-f02262fffec1 req-97963011-f819-4133-a290-f51301b05959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25ffb07-4fd4-4f81-9b29-40b0d136dabc", "name": "network-vif-plugged", "status": "completed", "tag": "25fbbbb1-f199-4497-bbdc-ad9bbf5dc18f"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:33.654202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-a82f35b6-00d0-4b97-9522-f02262fffec1 req-97963011-f819-4133-a290-f51301b05959 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.655092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-a82f35b6-00d0-4b97-9522-f02262fffec1 req-97963011-f819-4133-a290-f51301b05959 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.655649 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-a82f35b6-00d0-4b97-9522-f02262fffec1 req-97963011-f819-4133-a290-f51301b05959 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.667509 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-a82f35b6-00d0-4b97-9522-f02262fffec1 req-97963011-f819-4133-a290-f51301b05959 service nova] Creating event network-vif-plugged:25fbbbb1-f199-4497-bbdc-ad9bbf5dc18f for instance e25ffb07-4fd4-4f81-9b29-40b0d136dabc on hv-cinder-79797 Oct 27 09:44:33.672837 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-a82f35b6-00d0-4b97-9522-f02262fffec1 req-97963011-f819-4133-a290-f51301b05959 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040770 Oct 27 09:44:33.673747 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 559/1105] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:33.717051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:33.717555 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:33.723452 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.723936 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.724379 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.725216 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.725673 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.726099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.739721 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: DELETE /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f HTTP/1.1 Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:44:33.741416 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:44:33.743051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': 'd59eaa9a-23ee-4664-bea0-d16de93dfa7f'} Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:33.743948 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:44:33.745425 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.746916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:33.746916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b62e7749-f256-41e1-a5a5-1fbdebd6ad7d tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 404 len: 111 microversion: 2.1 time: 0.029793 Oct 27 09:44:33.746916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 547/1106] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:33 2022] DELETE /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:33.752344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:33.753072 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: d59eaa9a-23ee-4664-bea0-d16de93dfa7f] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:33.759747 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.760193 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.760654 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.761357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.761808 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.762224 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.777961 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f HTTP/1.1 Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:44:33.779486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:44:33.781105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': 'd59eaa9a-23ee-4664-bea0-d16de93dfa7f'} Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:33.782810 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. Oct 27 09:44:33.784032 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.786935 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance d59eaa9a-23ee-4664-bea0-d16de93dfa7f could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:33.786935 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8767b7aa-0c97-4b08-b6ef-e26b6bd3546e tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f" status: 404 len: 111 microversion: 2.1 time: 0.032771 Oct 27 09:44:33.786935 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 560/1107] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:33 2022] GET /compute/v2.1/servers/d59eaa9a-23ee-4664-bea0-d16de93dfa7f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:33.789470 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:33.789956 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:33.795851 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.796325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.796790 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.797468 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.797916 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.798332 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.815063 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: DELETE /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf HTTP/1.1 Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:44:33.816865 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:44:33.818204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '0757d24a-7369-4583-8b26-85d48e0ba6cf'} Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:33.818968 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:44:33.820179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.826414 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:33.826414 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-10e83861-bec2-411d-acac-affd9d68a87c tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 404 len: 111 microversion: 2.1 time: 0.032749 Oct 27 09:44:33.826414 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 548/1108] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:33 2022] DELETE /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:33.827569 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:33.828180 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 0757d24a-7369-4583-8b26-85d48e0ba6cf] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:33.834843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.835438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.835942 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.837820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:33.837820 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:33.838506 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:33.853435 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf HTTP/1.1 Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:44:33.855730 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:44:33.857438 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '0757d24a-7369-4583-8b26-85d48e0ba6cf'} Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:33.858326 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. Oct 27 09:44:33.859760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:33.861643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance 0757d24a-7369-4583-8b26-85d48e0ba6cf could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:33.861643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-8771e81b-2c5a-43b9-be43-d986252c4ca2 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf" status: 404 len: 111 microversion: 2.1 time: 0.033449 Oct 27 09:44:33.861643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 561/1109] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:33 2022] GET /compute/v2.1/servers/0757d24a-7369-4583-8b26-85d48e0ba6cf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:34.385500 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-08429753-019c-4f5f-a2f0-f715d3d91b30 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:34.386181 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-08429753-019c-4f5f-a2f0-f715d3d91b30 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:34.392814 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-08429753-019c-4f5f-a2f0-f715d3d91b30 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:34.393352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-08429753-019c-4f5f-a2f0-f715d3d91b30 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:34.393790 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-08429753-019c-4f5f-a2f0-f715d3d91b30 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:34.394486 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-08429753-019c-4f5f-a2f0-f715d3d91b30 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:34.394941 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-08429753-019c-4f5f-a2f0-f715d3d91b30 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:34.395364 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-08429753-019c-4f5f-a2f0-f715d3d91b30 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:34.528413 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-08429753-019c-4f5f-a2f0-f715d3d91b30 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:34.536177 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-08429753-019c-4f5f-a2f0-f715d3d91b30 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1314 microversion: 2.1 time: 0.154703 Oct 27 09:44:34.536704 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 549/1110] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:34 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:35.012233 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:35.012744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:35.019476 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:35.019997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:35.020437 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:35.021188 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:35.021646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:35.022073 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:35.035902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: DELETE /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc HTTP/1.1 Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:44:35.037463 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:44:35.039017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '03530ba9-438a-41c2-8e0c-72e90cc316cc'} Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:35.040726 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:44:35.042172 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:35.043824 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:35.043824 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-35ac5b7a-ddf3-4cda-85a5-7fee7be55ffb tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "DELETE /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 404 len: 111 microversion: 2.1 time: 0.030493 Oct 27 09:44:35.043824 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 562/1111] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:35 2022] DELETE /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:35.048175 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:35.048825 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] [instance: 03530ba9-438a-41c2-8e0c-72e90cc316cc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:35.054727 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:35.055216 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:35.055684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:35.056381 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:35.056868 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:35.057297 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:35.061202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:35.071780 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] HTTP exception thrown: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Request method failure captured: Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc HTTP/1.1 Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlF-FvCafXynZr6thW1JFgZmJOF5EKbIT9ooRc2eOdEtk_uTjNwbTwSwbnGY5ZBBkNDlaa8giGXsBE4OT0UOOiDjxbujgEfoAzXWOzDm1UaMCuZQMlarZuBPVzHyMdNVs_33IDfdLaQgQ7xZC5Y0UoirSz_jKkTAUUUC_R7qjJVhRmE Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:44:35.073618 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df84eaa566a24d3e8d25c1065e8c09fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: df84eaa566a24d3e8d25c1065e8c09fa Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-196751092 Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: f7d2c6275669404db608d714baeb0065 Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-AttachVolumeNegativeTest-196751092-project Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:44:35.076012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '03530ba9-438a-41c2-8e0c-72e90cc316cc'} Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:35.077189 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. Oct 27 09:44:35.078744 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:44:35.080434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] Returning 404 to user: Instance 03530ba9-438a-41c2-8e0c-72e90cc316cc could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:35.080434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e452437e-74f6-4866-aaeb-cc10939f24b8 tempest-AttachVolumeNegativeTest-196751092 tempest-AttachVolumeNegativeTest-196751092-project] 10.222.0.70 "GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc" status: 404 len: 111 microversion: 2.1 time: 0.030739 Oct 27 09:44:35.080434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 550/1112] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:35 2022] GET /compute/v2.1/servers/03530ba9-438a-41c2-8e0c-72e90cc316cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 09:44:35.559854 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ebfb1077-d57d-4199-b73a-44ee2f1b726f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:35.560704 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ebfb1077-d57d-4199-b73a-44ee2f1b726f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:35.567004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebfb1077-d57d-4199-b73a-44ee2f1b726f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:35.567486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebfb1077-d57d-4199-b73a-44ee2f1b726f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:35.568151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebfb1077-d57d-4199-b73a-44ee2f1b726f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:35.568880 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebfb1077-d57d-4199-b73a-44ee2f1b726f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:35.569368 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebfb1077-d57d-4199-b73a-44ee2f1b726f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:35.569838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ebfb1077-d57d-4199-b73a-44ee2f1b726f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:35.903169 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ebfb1077-d57d-4199-b73a-44ee2f1b726f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:35.910941 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ebfb1077-d57d-4199-b73a-44ee2f1b726f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1498 microversion: 2.1 time: 0.356259 Oct 27 09:44:35.911513 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 563/1113] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:35 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1498 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:36.332985 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-31f32456-6b0c-477d-855f-753bc748fcfe tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:36.333625 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-31f32456-6b0c-477d-855f-753bc748fcfe tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:36.340047 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-31f32456-6b0c-477d-855f-753bc748fcfe tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:36.340646 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-31f32456-6b0c-477d-855f-753bc748fcfe tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:36.341160 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-31f32456-6b0c-477d-855f-753bc748fcfe tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:36.341953 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-31f32456-6b0c-477d-855f-753bc748fcfe tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:36.342487 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-31f32456-6b0c-477d-855f-753bc748fcfe tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:36.342985 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-31f32456-6b0c-477d-855f-753bc748fcfe tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:36.369225 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-31f32456-6b0c-477d-855f-753bc748fcfe tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:44:36.450880 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-31f32456-6b0c-477d-855f-753bc748fcfe tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 204 len: 0 microversion: 2.1 time: 0.122408 Oct 27 09:44:36.454740 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 551/1114] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:36 2022] DELETE /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:44:36.460184 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4c740a4d-c39c-469b-a6d3-9666ee1842fa tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:36.461098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4c740a4d-c39c-469b-a6d3-9666ee1842fa tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:36.469952 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4c740a4d-c39c-469b-a6d3-9666ee1842fa tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:36.470525 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4c740a4d-c39c-469b-a6d3-9666ee1842fa tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:36.471075 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4c740a4d-c39c-469b-a6d3-9666ee1842fa tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:36.471862 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4c740a4d-c39c-469b-a6d3-9666ee1842fa tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:36.472420 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4c740a4d-c39c-469b-a6d3-9666ee1842fa tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:36.472938 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4c740a4d-c39c-469b-a6d3-9666ee1842fa tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:36.701004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4c740a4d-c39c-469b-a6d3-9666ee1842fa tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:36.719330 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4c740a4d-c39c-469b-a6d3-9666ee1842fa tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1504 microversion: 2.1 time: 0.263151 Oct 27 09:44:36.734784 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 564/1115] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:36 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:37.744447 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b8eec5c2-afb0-40ae-a11d-44a9595544f2 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:37.745519 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-b8eec5c2-afb0-40ae-a11d-44a9595544f2 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:37.754995 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b8eec5c2-afb0-40ae-a11d-44a9595544f2 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:37.755483 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b8eec5c2-afb0-40ae-a11d-44a9595544f2 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:37.760611 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b8eec5c2-afb0-40ae-a11d-44a9595544f2 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:37.761907 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b8eec5c2-afb0-40ae-a11d-44a9595544f2 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:37.764696 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b8eec5c2-afb0-40ae-a11d-44a9595544f2 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:37.767134 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-b8eec5c2-afb0-40ae-a11d-44a9595544f2 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:38.005431 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-b8eec5c2-afb0-40ae-a11d-44a9595544f2 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:38.026281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b8eec5c2-afb0-40ae-a11d-44a9595544f2 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1504 microversion: 2.1 time: 0.278949 Oct 27 09:44:38.027479 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 552/1116] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:37 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:38.564998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-0d543ddd-4694-4dc4-aabb-961fd0410c0b req-23d43e1b-baea-41dd-8f94-72a619b00d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25ffb07-4fd4-4f81-9b29-40b0d136dabc", "name": "network-vif-deleted", "tag": "25fbbbb1-f199-4497-bbdc-ad9bbf5dc18f"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:38.583108 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-0d543ddd-4694-4dc4-aabb-961fd0410c0b req-23d43e1b-baea-41dd-8f94-72a619b00d89 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:38.583980 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-0d543ddd-4694-4dc4-aabb-961fd0410c0b req-23d43e1b-baea-41dd-8f94-72a619b00d89 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:38.584477 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-0d543ddd-4694-4dc4-aabb-961fd0410c0b req-23d43e1b-baea-41dd-8f94-72a619b00d89 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:38.596342 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-0d543ddd-4694-4dc4-aabb-961fd0410c0b req-23d43e1b-baea-41dd-8f94-72a619b00d89 service nova] Creating event network-vif-deleted:25fbbbb1-f199-4497-bbdc-ad9bbf5dc18f for instance e25ffb07-4fd4-4f81-9b29-40b0d136dabc on hv-cinder-79797 Oct 27 09:44:38.602151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-0d543ddd-4694-4dc4-aabb-961fd0410c0b req-23d43e1b-baea-41dd-8f94-72a619b00d89 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040912 Oct 27 09:44:38.603385 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 565/1117] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:39.050798 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:39.051912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:39.059242 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:39.059973 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:39.060598 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:39.061471 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:39.062114 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:39.062702 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:39.101678 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:39.103804 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:39.104748 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:39.105541 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lazy-loading 'fault' on Instance uuid e25ffb07-4fd4-4f81-9b29-40b0d136dabc {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:44:39.188266 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:39.197089 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-e3b43345-759f-423f-a86c-7113ce436ed6 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 200 len: 1304 microversion: 2.1 time: 0.149911 Oct 27 09:44:39.213515 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 553/1118] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:39 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 1304 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:40.223227 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:40.224708 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: e25ffb07-4fd4-4f81-9b29-40b0d136dabc] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:40.232116 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:40.232898 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:40.233319 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:40.234024 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:40.234471 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:40.234926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:40.255492 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] HTTP exception thrown: Instance e25ffb07-4fd4-4f81-9b29-40b0d136dabc could not be found. Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Request method failure captured: Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc HTTP/1.1 Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlLzBE6QyuCwFBzsC1d6s8DNrixxGOWBBvSmkcKuRPGYjMo8oM9jAXftj1FH3vDGITNw3yyOa1uaC7L8HgQZFby_LPHf1EUqBbGNAbBv-i3x76RW37LGQ-iVRcj0_3V8W92oCxicoJBazNMfot0RAiNjGJrw0nMobUXGDLQgZvmgP7M Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: f5b8d4a1ce084cc6b3e84ebb7778e5ae Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-VolumesActionsTest-753587400 Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:44:40.257223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5b8d4a1ce084cc6b3e84ebb7778e5ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5b8d4a1ce084cc6b3e84ebb7778e5ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5b8d4a1ce084cc6b3e84ebb7778e5ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5b8d4a1ce084cc6b3e84ebb7778e5ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-VolumesActionsTest-753587400 Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: f5b8d4a1ce084cc6b3e84ebb7778e5ae Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-VolumesActionsTest-753587400 Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-VolumesActionsTest-753587400-project Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 52ac2b5469904e4a8a742de14fcc8508 Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-VolumesActionsTest-753587400-project Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance e25ffb07-4fd4-4f81-9b29-40b0d136dabc could not be found. Oct 27 09:44:40.259121 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': 'e25ffb07-4fd4-4f81-9b29-40b0d136dabc'} Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e25ffb07-4fd4-4f81-9b29-40b0d136dabc could not be found. Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:44:40.259926 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e25ffb07-4fd4-4f81-9b29-40b0d136dabc could not be found. Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e25ffb07-4fd4-4f81-9b29-40b0d136dabc could not be found. Oct 27 09:44:40.262064 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:44:40.264506 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Returning 404 to user: Instance e25ffb07-4fd4-4f81-9b29-40b0d136dabc could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:44:40.264506 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c4f55876-d47b-4574-a4cb-e71e3ef90591 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc" status: 404 len: 111 microversion: 2.1 time: 0.040527 Oct 27 09:44:40.269863 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 566/1119] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:40 2022] GET /compute/v2.1/servers/e25ffb07-4fd4-4f81-9b29-40b0d136dabc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:44:40.376472 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-910338963", "imageRef": "f8048a76-dbce-4ffa-ba94-2d3ba86af9e3", "flavorRef": "452", "networks": [{"uuid": "044dd9bc-8607-4d16-b4ca-805b7d777203"}]}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:40.439639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] validate_networks() for [('044dd9bc-8607-4d16-b4ca-805b7d777203', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:44:40.825764 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:44:40.826215 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:44:40.826738 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:44:40.827075 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:44:40.827484 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:44:40.837037 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:40.837920 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:40.838850 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:40.839918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:40.840369 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:40.841036 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:40.862421 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Getting quotas for project f5b8d4a1ce084cc6b3e84ebb7778e5ae. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:44:40.866780 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Getting quotas for user 52ac2b5469904e4a8a742de14fcc8508 and project f5b8d4a1ce084cc6b3e84ebb7778e5ae. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:44:40.890092 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:44:40.892972 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f8048a76-dbce-4ffa-ba94-2d3ba86af9e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:44:40.953947 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d686a717-f813-45b6-8a80-5b0fad4c0554 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579269 Oct 27 09:44:40.954913 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 554/1120] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:44:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 09:44:40.967420 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-aeac73b3-df19-4e5f-a11d-e98256db15bb tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:40.968496 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-aeac73b3-df19-4e5f-a11d-e98256db15bb tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:41.044335 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-aeac73b3-df19-4e5f-a11d-e98256db15bb tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:41.051445 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-aeac73b3-df19-4e5f-a11d-e98256db15bb tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1213 microversion: 2.1 time: 0.088149 Oct 27 09:44:41.052025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 567/1121] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:40 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:42.076893 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7b50ef1d-8836-4450-8e21-f9a0c004ac24 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:42.078243 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7b50ef1d-8836-4450-8e21-f9a0c004ac24 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:42.087945 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7b50ef1d-8836-4450-8e21-f9a0c004ac24 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:42.088444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7b50ef1d-8836-4450-8e21-f9a0c004ac24 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:42.088911 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7b50ef1d-8836-4450-8e21-f9a0c004ac24 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:42.089605 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7b50ef1d-8836-4450-8e21-f9a0c004ac24 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:42.090055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7b50ef1d-8836-4450-8e21-f9a0c004ac24 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:42.090473 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7b50ef1d-8836-4450-8e21-f9a0c004ac24 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:42.189601 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7b50ef1d-8836-4450-8e21-f9a0c004ac24 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:42.202567 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7b50ef1d-8836-4450-8e21-f9a0c004ac24 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1265 microversion: 2.1 time: 0.132260 Oct 27 09:44:42.219731 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 555/1122] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:42 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:43.229315 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ea8a72dd-bc71-4321-8d9e-ee561481b91a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:43.229928 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ea8a72dd-bc71-4321-8d9e-ee561481b91a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:43.237098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ea8a72dd-bc71-4321-8d9e-ee561481b91a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:43.237579 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ea8a72dd-bc71-4321-8d9e-ee561481b91a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:43.238016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ea8a72dd-bc71-4321-8d9e-ee561481b91a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:43.238708 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ea8a72dd-bc71-4321-8d9e-ee561481b91a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:43.239159 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ea8a72dd-bc71-4321-8d9e-ee561481b91a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:43.239582 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ea8a72dd-bc71-4321-8d9e-ee561481b91a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:43.376895 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ea8a72dd-bc71-4321-8d9e-ee561481b91a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:43.385175 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ea8a72dd-bc71-4321-8d9e-ee561481b91a tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.160354 Oct 27 09:44:43.386168 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 568/1123] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:43 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:44.409358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7579d5d6-c45b-4f5e-a175-f0695837e44e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:44.409974 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7579d5d6-c45b-4f5e-a175-f0695837e44e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:44.417010 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7579d5d6-c45b-4f5e-a175-f0695837e44e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:44.417585 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7579d5d6-c45b-4f5e-a175-f0695837e44e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:44.418093 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7579d5d6-c45b-4f5e-a175-f0695837e44e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:44.418917 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7579d5d6-c45b-4f5e-a175-f0695837e44e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:44.419629 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7579d5d6-c45b-4f5e-a175-f0695837e44e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:44.420091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7579d5d6-c45b-4f5e-a175-f0695837e44e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:44.562890 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7579d5d6-c45b-4f5e-a175-f0695837e44e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:44.570645 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7579d5d6-c45b-4f5e-a175-f0695837e44e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.165101 Oct 27 09:44:44.571217 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 556/1124] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:44 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:45.594045 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-79a17daf-e37f-4541-b5d3-0d03c8954d34 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:45.595496 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-79a17daf-e37f-4541-b5d3-0d03c8954d34 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:45.602425 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79a17daf-e37f-4541-b5d3-0d03c8954d34 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:45.602907 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79a17daf-e37f-4541-b5d3-0d03c8954d34 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:45.604097 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79a17daf-e37f-4541-b5d3-0d03c8954d34 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:45.604997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79a17daf-e37f-4541-b5d3-0d03c8954d34 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:45.605312 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79a17daf-e37f-4541-b5d3-0d03c8954d34 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:45.605745 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-79a17daf-e37f-4541-b5d3-0d03c8954d34 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:46.244714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-79a17daf-e37f-4541-b5d3-0d03c8954d34 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:46.252467 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-79a17daf-e37f-4541-b5d3-0d03c8954d34 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.662550 Oct 27 09:44:46.253069 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 569/1125] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:45 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:46.664922 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-a7712508-3bc4-4b13-b14b-6844e194fcb1 req-4e84a2d3-e325-4097-8730-5064b87ba8ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10152467-3977-4e4b-8c8d-8e642fe862a0", "tag": "b1da9923-ed74-46a7-a1bb-8eaa940fe8e3"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:46.674804 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a7712508-3bc4-4b13-b14b-6844e194fcb1 req-4e84a2d3-e325-4097-8730-5064b87ba8ac service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:46.675275 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a7712508-3bc4-4b13-b14b-6844e194fcb1 req-4e84a2d3-e325-4097-8730-5064b87ba8ac service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:46.675703 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a7712508-3bc4-4b13-b14b-6844e194fcb1 req-4e84a2d3-e325-4097-8730-5064b87ba8ac service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:46.686909 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-a7712508-3bc4-4b13-b14b-6844e194fcb1 req-4e84a2d3-e325-4097-8730-5064b87ba8ac service nova] Creating event network-changed:b1da9923-ed74-46a7-a1bb-8eaa940fe8e3 for instance 10152467-3977-4e4b-8c8d-8e642fe862a0 on hv-cinder-79797 Oct 27 09:44:46.692324 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-a7712508-3bc4-4b13-b14b-6844e194fcb1 req-4e84a2d3-e325-4097-8730-5064b87ba8ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030837 Oct 27 09:44:46.693004 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 557/1126] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:44:47.275247 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-858e6a25-ea7e-40af-8a27-a1ad9b4f774c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:47.275856 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-858e6a25-ea7e-40af-8a27-a1ad9b4f774c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:47.282338 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-858e6a25-ea7e-40af-8a27-a1ad9b4f774c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:47.282816 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-858e6a25-ea7e-40af-8a27-a1ad9b4f774c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:47.283249 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-858e6a25-ea7e-40af-8a27-a1ad9b4f774c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:47.283944 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-858e6a25-ea7e-40af-8a27-a1ad9b4f774c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:47.284391 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-858e6a25-ea7e-40af-8a27-a1ad9b4f774c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:47.284858 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-858e6a25-ea7e-40af-8a27-a1ad9b4f774c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:47.417314 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-858e6a25-ea7e-40af-8a27-a1ad9b4f774c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:47.424839 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-858e6a25-ea7e-40af-8a27-a1ad9b4f774c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.153474 Oct 27 09:44:47.425399 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 570/1127] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:47 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:48.448002 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8803a779-56e7-4a33-8112-c0eef94ad088 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:48.448738 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8803a779-56e7-4a33-8112-c0eef94ad088 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:48.455908 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8803a779-56e7-4a33-8112-c0eef94ad088 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:48.456326 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8803a779-56e7-4a33-8112-c0eef94ad088 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:48.456817 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8803a779-56e7-4a33-8112-c0eef94ad088 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:48.457520 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8803a779-56e7-4a33-8112-c0eef94ad088 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:48.457980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8803a779-56e7-4a33-8112-c0eef94ad088 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:48.458403 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8803a779-56e7-4a33-8112-c0eef94ad088 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:48.599238 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8803a779-56e7-4a33-8112-c0eef94ad088 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:48.607059 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8803a779-56e7-4a33-8112-c0eef94ad088 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.163654 Oct 27 09:44:48.608022 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 558/1128] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:48 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:49.630621 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d338c602-4578-46ab-b3d8-7dab3a7eb7ca tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:49.631332 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d338c602-4578-46ab-b3d8-7dab3a7eb7ca tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:49.638891 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d338c602-4578-46ab-b3d8-7dab3a7eb7ca tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:49.639377 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d338c602-4578-46ab-b3d8-7dab3a7eb7ca tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:49.639815 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d338c602-4578-46ab-b3d8-7dab3a7eb7ca tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:49.640509 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d338c602-4578-46ab-b3d8-7dab3a7eb7ca tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:49.640991 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d338c602-4578-46ab-b3d8-7dab3a7eb7ca tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:49.641416 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d338c602-4578-46ab-b3d8-7dab3a7eb7ca tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:49.804166 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d338c602-4578-46ab-b3d8-7dab3a7eb7ca tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:49.812335 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d338c602-4578-46ab-b3d8-7dab3a7eb7ca tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.185647 Oct 27 09:44:49.812941 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 571/1129] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:49 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:50.836117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-8dc62236-4ea9-4173-8c57-928d044c00b3 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:50.836774 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-8dc62236-4ea9-4173-8c57-928d044c00b3 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:50.843676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8dc62236-4ea9-4173-8c57-928d044c00b3 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.844379 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8dc62236-4ea9-4173-8c57-928d044c00b3 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.844841 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8dc62236-4ea9-4173-8c57-928d044c00b3 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.845542 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8dc62236-4ea9-4173-8c57-928d044c00b3 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:50.846031 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8dc62236-4ea9-4173-8c57-928d044c00b3 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:50.846467 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-8dc62236-4ea9-4173-8c57-928d044c00b3 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:50.850639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:50.883252 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=6 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:51.023415 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-8dc62236-4ea9-4173-8c57-928d044c00b3 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:51.032298 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-8dc62236-4ea9-4173-8c57-928d044c00b3 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.199968 Oct 27 09:44:51.033179 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 559/1130] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:50 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:52.056802 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-32aa7e89-5cbf-4284-8cb3-95eaad78d801 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:52.057413 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-32aa7e89-5cbf-4284-8cb3-95eaad78d801 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:52.060819 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:52.064876 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32aa7e89-5cbf-4284-8cb3-95eaad78d801 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:52.065359 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32aa7e89-5cbf-4284-8cb3-95eaad78d801 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:52.065791 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32aa7e89-5cbf-4284-8cb3-95eaad78d801 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:52.066517 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32aa7e89-5cbf-4284-8cb3-95eaad78d801 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:52.066928 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32aa7e89-5cbf-4284-8cb3-95eaad78d801 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:52.067348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-32aa7e89-5cbf-4284-8cb3-95eaad78d801 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:52.202122 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-32aa7e89-5cbf-4284-8cb3-95eaad78d801 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:52.209929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-32aa7e89-5cbf-4284-8cb3-95eaad78d801 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.157453 Oct 27 09:44:52.210499 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 572/1131] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:52 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:53.232714 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-de670432-325d-4214-9cce-509a3da18b51 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:53.233354 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-de670432-325d-4214-9cce-509a3da18b51 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:53.235835 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:53.241094 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de670432-325d-4214-9cce-509a3da18b51 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:53.241719 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de670432-325d-4214-9cce-509a3da18b51 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:53.242153 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de670432-325d-4214-9cce-509a3da18b51 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:53.242850 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de670432-325d-4214-9cce-509a3da18b51 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:53.243303 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de670432-325d-4214-9cce-509a3da18b51 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:53.243729 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-de670432-325d-4214-9cce-509a3da18b51 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:53.382146 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-de670432-325d-4214-9cce-509a3da18b51 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:53.390332 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-de670432-325d-4214-9cce-509a3da18b51 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.161561 Oct 27 09:44:53.390935 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 560/1132] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:53 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:44:54.414234 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a3df7eaa-b564-411d-a850-b6402e52205d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:54.423491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a3df7eaa-b564-411d-a850-b6402e52205d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:54.432701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3df7eaa-b564-411d-a850-b6402e52205d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:54.433423 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3df7eaa-b564-411d-a850-b6402e52205d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:54.434150 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3df7eaa-b564-411d-a850-b6402e52205d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:54.445022 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3df7eaa-b564-411d-a850-b6402e52205d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:54.445610 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3df7eaa-b564-411d-a850-b6402e52205d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:54.446523 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a3df7eaa-b564-411d-a850-b6402e52205d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:54.451565 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=100 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:54.522365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-2d850853-0bed-4c92-991c-400f72faf1e2 req-87fbe852-92f1-40a4-a2f5-2999e9faaf3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10152467-3977-4e4b-8c8d-8e642fe862a0", "name": "network-vif-plugged", "status": "completed", "tag": "b1da9923-ed74-46a7-a1bb-8eaa940fe8e3"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:44:54.552474 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-2d850853-0bed-4c92-991c-400f72faf1e2 req-87fbe852-92f1-40a4-a2f5-2999e9faaf3c service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:54.554032 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-2d850853-0bed-4c92-991c-400f72faf1e2 req-87fbe852-92f1-40a4-a2f5-2999e9faaf3c service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:54.559858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-2d850853-0bed-4c92-991c-400f72faf1e2 req-87fbe852-92f1-40a4-a2f5-2999e9faaf3c service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:54.581494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-2d850853-0bed-4c92-991c-400f72faf1e2 req-87fbe852-92f1-40a4-a2f5-2999e9faaf3c service nova] Creating event network-vif-plugged:b1da9923-ed74-46a7-a1bb-8eaa940fe8e3 for instance 10152467-3977-4e4b-8c8d-8e642fe862a0 on hv-cinder-79797 Oct 27 09:44:54.590262 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-2d850853-0bed-4c92-991c-400f72faf1e2 req-87fbe852-92f1-40a4-a2f5-2999e9faaf3c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072678 Oct 27 09:44:54.590866 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 561/1133] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:44:54.591191 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a3df7eaa-b564-411d-a850-b6402e52205d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:54.599328 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a3df7eaa-b564-411d-a850-b6402e52205d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.188894 Oct 27 09:44:54.599902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 573/1134] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:54 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:55.623279 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-cf47f141-9f52-4130-8e5f-8f62492cd84e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:55.624103 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-cf47f141-9f52-4130-8e5f-8f62492cd84e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:55.631080 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf47f141-9f52-4130-8e5f-8f62492cd84e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:55.631566 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf47f141-9f52-4130-8e5f-8f62492cd84e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:55.631999 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf47f141-9f52-4130-8e5f-8f62492cd84e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:55.632725 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf47f141-9f52-4130-8e5f-8f62492cd84e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:55.633182 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf47f141-9f52-4130-8e5f-8f62492cd84e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:55.633635 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-cf47f141-9f52-4130-8e5f-8f62492cd84e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:55.766752 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-cf47f141-9f52-4130-8e5f-8f62492cd84e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:55.774594 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-cf47f141-9f52-4130-8e5f-8f62492cd84e tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.156495 Oct 27 09:44:55.775706 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 562/1135] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:55 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:56.798051 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-97f4033a-5f71-4ef0-8ea6-30255443ff0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:56.798615 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-97f4033a-5f71-4ef0-8ea6-30255443ff0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:56.801154 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:44:56.809196 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-97f4033a-5f71-4ef0-8ea6-30255443ff0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:56.809704 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-97f4033a-5f71-4ef0-8ea6-30255443ff0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:56.810135 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-97f4033a-5f71-4ef0-8ea6-30255443ff0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:56.810827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-97f4033a-5f71-4ef0-8ea6-30255443ff0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:56.811270 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-97f4033a-5f71-4ef0-8ea6-30255443ff0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:56.811686 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-97f4033a-5f71-4ef0-8ea6-30255443ff0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:56.942409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-97f4033a-5f71-4ef0-8ea6-30255443ff0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:56.950684 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-97f4033a-5f71-4ef0-8ea6-30255443ff0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.156696 Oct 27 09:44:56.951244 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 574/1136] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:56 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:57.972335 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-da8c53b8-2bd3-4129-85ea-4c39de9efe14 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:57.972981 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-da8c53b8-2bd3-4129-85ea-4c39de9efe14 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:57.979651 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da8c53b8-2bd3-4129-85ea-4c39de9efe14 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:57.980131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da8c53b8-2bd3-4129-85ea-4c39de9efe14 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:57.980602 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da8c53b8-2bd3-4129-85ea-4c39de9efe14 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:57.981364 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da8c53b8-2bd3-4129-85ea-4c39de9efe14 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:57.981817 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da8c53b8-2bd3-4129-85ea-4c39de9efe14 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:57.982235 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-da8c53b8-2bd3-4129-85ea-4c39de9efe14 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:58.109532 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-da8c53b8-2bd3-4129-85ea-4c39de9efe14 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:58.117222 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-da8c53b8-2bd3-4129-85ea-4c39de9efe14 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1313 microversion: 2.1 time: 0.148743 Oct 27 09:44:58.117787 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 563/1137] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:57 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:59.140999 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f88d6d04-b682-4fc1-8bef-6550025e13a0 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:59.141614 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f88d6d04-b682-4fc1-8bef-6550025e13a0 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:59.147886 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f88d6d04-b682-4fc1-8bef-6550025e13a0 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.148366 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f88d6d04-b682-4fc1-8bef-6550025e13a0 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.149039 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f88d6d04-b682-4fc1-8bef-6550025e13a0 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:59.149732 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f88d6d04-b682-4fc1-8bef-6550025e13a0 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.150189 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f88d6d04-b682-4fc1-8bef-6550025e13a0 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.150615 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f88d6d04-b682-4fc1-8bef-6550025e13a0 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:59.290844 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f88d6d04-b682-4fc1-8bef-6550025e13a0 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:44:59.298585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f88d6d04-b682-4fc1-8bef-6550025e13a0 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1498 microversion: 2.1 time: 0.161451 Oct 27 09:44:59.299146 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 575/1138] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:59 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:44:59.772783 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1b5aac7f-d409-4192-9936-55b63fde3a0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:59.773285 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1b5aac7f-d409-4192-9936-55b63fde3a0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:59.779750 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b5aac7f-d409-4192-9936-55b63fde3a0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.780234 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b5aac7f-d409-4192-9936-55b63fde3a0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.780704 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b5aac7f-d409-4192-9936-55b63fde3a0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:59.781439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b5aac7f-d409-4192-9936-55b63fde3a0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.781953 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b5aac7f-d409-4192-9936-55b63fde3a0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.782374 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1b5aac7f-d409-4192-9936-55b63fde3a0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:59.807976 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1b5aac7f-d409-4192-9936-55b63fde3a0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:44:59.882501 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1b5aac7f-d409-4192-9936-55b63fde3a0f tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "DELETE /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 204 len: 0 microversion: 2.1 time: 0.113353 Oct 27 09:44:59.883328 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 564/1139] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:44:59 2022] DELETE /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 09:44:59.891470 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-63b0c510-e5af-4fa1-8b20-883b82f6ee3c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:44:59.892329 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-63b0c510-e5af-4fa1-8b20-883b82f6ee3c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:44:59.898409 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63b0c510-e5af-4fa1-8b20-883b82f6ee3c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.898891 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63b0c510-e5af-4fa1-8b20-883b82f6ee3c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.899322 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63b0c510-e5af-4fa1-8b20-883b82f6ee3c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:44:59.900014 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63b0c510-e5af-4fa1-8b20-883b82f6ee3c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:44:59.900485 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63b0c510-e5af-4fa1-8b20-883b82f6ee3c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:44:59.901029 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-63b0c510-e5af-4fa1-8b20-883b82f6ee3c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:00.033306 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-63b0c510-e5af-4fa1-8b20-883b82f6ee3c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:00.040931 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-63b0c510-e5af-4fa1-8b20-883b82f6ee3c tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1504 microversion: 2.1 time: 0.153272 Oct 27 09:45:00.042010 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 576/1140] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:44:59 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:01.066447 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fdc0ec82-f916-4ced-aec4-aae222e17a79 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:01.067221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fdc0ec82-f916-4ced-aec4-aae222e17a79 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:01.076651 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fdc0ec82-f916-4ced-aec4-aae222e17a79 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:01.077410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fdc0ec82-f916-4ced-aec4-aae222e17a79 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:01.077960 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fdc0ec82-f916-4ced-aec4-aae222e17a79 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:01.078739 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fdc0ec82-f916-4ced-aec4-aae222e17a79 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:01.079204 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fdc0ec82-f916-4ced-aec4-aae222e17a79 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:01.079629 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fdc0ec82-f916-4ced-aec4-aae222e17a79 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:01.211800 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fdc0ec82-f916-4ced-aec4-aae222e17a79 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:01.214750 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:45:01.221698 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fdc0ec82-f916-4ced-aec4-aae222e17a79 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1504 microversion: 2.1 time: 0.159582 Oct 27 09:45:01.222260 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 565/1141] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:01 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:02.251140 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f978f7dd-839e-4dd3-a174-8ce2297129b1 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:02.251702 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f978f7dd-839e-4dd3-a174-8ce2297129b1 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:02.258138 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f978f7dd-839e-4dd3-a174-8ce2297129b1 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:02.258706 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f978f7dd-839e-4dd3-a174-8ce2297129b1 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:02.259145 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f978f7dd-839e-4dd3-a174-8ce2297129b1 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:02.259842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f978f7dd-839e-4dd3-a174-8ce2297129b1 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:02.260314 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f978f7dd-839e-4dd3-a174-8ce2297129b1 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:02.260772 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f978f7dd-839e-4dd3-a174-8ce2297129b1 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:02.392395 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-f978f7dd-839e-4dd3-a174-8ce2297129b1 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:02.400130 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f978f7dd-839e-4dd3-a174-8ce2297129b1 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1504 microversion: 2.1 time: 0.152930 Oct 27 09:45:02.400724 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 577/1142] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:02 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:03.423626 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-04f24d22-6b07-4703-a4fc-a83d469ddb40 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:03.424238 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-04f24d22-6b07-4703-a4fc-a83d469ddb40 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:03.432017 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04f24d22-6b07-4703-a4fc-a83d469ddb40 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:03.432502 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04f24d22-6b07-4703-a4fc-a83d469ddb40 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:03.432971 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04f24d22-6b07-4703-a4fc-a83d469ddb40 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:03.433665 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04f24d22-6b07-4703-a4fc-a83d469ddb40 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:03.434123 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04f24d22-6b07-4703-a4fc-a83d469ddb40 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:03.434551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-04f24d22-6b07-4703-a4fc-a83d469ddb40 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:03.560760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-04f24d22-6b07-4703-a4fc-a83d469ddb40 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:03.568428 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-04f24d22-6b07-4703-a4fc-a83d469ddb40 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1504 microversion: 2.1 time: 0.148674 Oct 27 09:45:03.569023 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 566/1143] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:03 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:45:04.586320 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-5e22327f-43f7-4cce-8509-c402b766444a req-09b26720-bed4-4fe5-95f5-891c23b4f8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10152467-3977-4e4b-8c8d-8e642fe862a0", "name": "network-vif-deleted", "tag": "b1da9923-ed74-46a7-a1bb-8eaa940fe8e3"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:45:04.592636 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c8bbfdc4-9acf-4961-a386-9d1fff1b2510 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:04.593264 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c8bbfdc4-9acf-4961-a386-9d1fff1b2510 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:04.599384 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc4-9acf-4961-a386-9d1fff1b2510 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:04.599951 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc4-9acf-4961-a386-9d1fff1b2510 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:04.600307 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc4-9acf-4961-a386-9d1fff1b2510 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:04.601049 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc4-9acf-4961-a386-9d1fff1b2510 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:04.601504 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc4-9acf-4961-a386-9d1fff1b2510 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:04.601961 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c8bbfdc4-9acf-4961-a386-9d1fff1b2510 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:04.606519 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5e22327f-43f7-4cce-8509-c402b766444a req-09b26720-bed4-4fe5-95f5-891c23b4f8ff service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:04.607004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5e22327f-43f7-4cce-8509-c402b766444a req-09b26720-bed4-4fe5-95f5-891c23b4f8ff service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:04.607434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5e22327f-43f7-4cce-8509-c402b766444a req-09b26720-bed4-4fe5-95f5-891c23b4f8ff service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:04.618998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-5e22327f-43f7-4cce-8509-c402b766444a req-09b26720-bed4-4fe5-95f5-891c23b4f8ff service nova] Creating event network-vif-deleted:b1da9923-ed74-46a7-a1bb-8eaa940fe8e3 for instance 10152467-3977-4e4b-8c8d-8e642fe862a0 on hv-cinder-79797 Oct 27 09:45:04.624211 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-5e22327f-43f7-4cce-8509-c402b766444a req-09b26720-bed4-4fe5-95f5-891c23b4f8ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041565 Oct 27 09:45:04.625166 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 578/1144] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:45:04.667518 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c8bbfdc4-9acf-4961-a386-9d1fff1b2510 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ac2b5469904e4a8a742de14fcc8508', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b8d4a1ce084cc6b3e84ebb7778e5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:45:04.676888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c8bbfdc4-9acf-4961-a386-9d1fff1b2510 tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 200 len: 1462 microversion: 2.1 time: 0.088640 Oct 27 09:45:04.677465 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 567/1145] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:04 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:45:05.702123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:45:05.702849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] [instance: 10152467-3977-4e4b-8c8d-8e642fe862a0] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:45:05.708878 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:05.709366 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:05.709803 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:05.710486 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:45:05.710939 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:45:05.711360 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:45:05.725411 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] HTTP exception thrown: Instance 10152467-3977-4e4b-8c8d-8e642fe862a0 could not be found. Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Request method failure captured: Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 HTTP/1.1 Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlLzBE6QyuCwFBzsC1d6s8DNrixxGOWBBvSmkcKuRPGYjMo8oM9jAXftj1FH3vDGITNw3yyOa1uaC7L8HgQZFby_LPHf1EUqBbGNAbBv-i3x76RW37LGQ-iVRcj0_3V8W92oCxicoJBazNMfot0RAiNjGJrw0nMobUXGDLQgZvmgP7M Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: f5b8d4a1ce084cc6b3e84ebb7778e5ae Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-VolumesActionsTest-753587400 Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:45:05.727070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f5b8d4a1ce084cc6b3e84ebb7778e5ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5b8d4a1ce084cc6b3e84ebb7778e5ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f5b8d4a1ce084cc6b3e84ebb7778e5ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f5b8d4a1ce084cc6b3e84ebb7778e5ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-VolumesActionsTest-753587400 Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: f5b8d4a1ce084cc6b3e84ebb7778e5ae Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-VolumesActionsTest-753587400 Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-VolumesActionsTest-753587400-project Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 52ac2b5469904e4a8a742de14fcc8508 Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-VolumesActionsTest-753587400-project Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 10152467-3977-4e4b-8c8d-8e642fe862a0 could not be found. Oct 27 09:45:05.728817 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '10152467-3977-4e4b-8c8d-8e642fe862a0'} Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10152467-3977-4e4b-8c8d-8e642fe862a0 could not be found. Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:45:05.729643 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10152467-3977-4e4b-8c8d-8e642fe862a0 could not be found. Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10152467-3977-4e4b-8c8d-8e642fe862a0 could not be found. Oct 27 09:45:05.731552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:45:05.732778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] Returning 404 to user: Instance 10152467-3977-4e4b-8c8d-8e642fe862a0 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:45:05.732778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-0e59aa19-c2dd-4072-85ea-da18984ff79d tempest-VolumesActionsTest-753587400 tempest-VolumesActionsTest-753587400-project] 10.222.0.70 "GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0" status: 404 len: 111 microversion: 2.1 time: 0.032157 Oct 27 09:45:05.732778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 579/1146] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:45:05 2022] GET /compute/v2.1/servers/10152467-3977-4e4b-8c8d-8e642fe862a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:46:36.473261 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c1b86e17-9c59-4561-8a6b-b3aab955193c] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 27 09:46:36.474408 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:36.475149 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=13 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:36.479934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-46920764-ef82-4c9e-a652-5ca03a508957 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:36.480436 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-46920764-ef82-4c9e-a652-5ca03a508957 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:36.487771 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46920764-ef82-4c9e-a652-5ca03a508957 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:36.488294 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46920764-ef82-4c9e-a652-5ca03a508957 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:36.488875 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46920764-ef82-4c9e-a652-5ca03a508957 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:36.489576 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46920764-ef82-4c9e-a652-5ca03a508957 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:36.490032 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46920764-ef82-4c9e-a652-5ca03a508957 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:36.490460 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46920764-ef82-4c9e-a652-5ca03a508957 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:36.518817 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-46920764-ef82-4c9e-a652-5ca03a508957 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:46:36.592709 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-46920764-ef82-4c9e-a652-5ca03a508957 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 204 len: 0 microversion: 2.1 time: 0.121085 Oct 27 09:46:36.593888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 568/1147] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:46:36 2022] DELETE /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:46:36.600222 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:46:36.600763 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Thu Oct 27 09:46:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 (ip 10.222.0.70) !!! Oct 27 09:46:36.601435 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=11 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:36.602161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=32 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:36.607004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-a5130420-fdb9-408a-8759-176fa609269a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:36.607607 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-a5130420-fdb9-408a-8759-176fa609269a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:36.616618 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a5130420-fdb9-408a-8759-176fa609269a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:36.617114 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a5130420-fdb9-408a-8759-176fa609269a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:36.617540 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a5130420-fdb9-408a-8759-176fa609269a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:36.618223 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a5130420-fdb9-408a-8759-176fa609269a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:36.618670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a5130420-fdb9-408a-8759-176fa609269a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:36.619090 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-a5130420-fdb9-408a-8759-176fa609269a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:36.922678 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-a5130420-fdb9-408a-8759-176fa609269a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:36.930385 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-a5130420-fdb9-408a-8759-176fa609269a tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1577 microversion: 2.1 time: 0.332314 Oct 27 09:46:36.931295 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 580/1148] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:36 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1577 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:37.955268 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-c9338d21-9053-4fe7-ad61-a4951fd4f566 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:37.955972 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-c9338d21-9053-4fe7-ad61-a4951fd4f566 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:37.966616 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO oslo.messaging._drivers.impl_rabbit [-] [c1b86e17-9c59-4561-8a6b-b3aab955193c] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39356. Oct 27 09:46:37.970616 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9338d21-9053-4fe7-ad61-a4951fd4f566 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:37.971096 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9338d21-9053-4fe7-ad61-a4951fd4f566 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:37.971533 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9338d21-9053-4fe7-ad61-a4951fd4f566 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:37.972229 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9338d21-9053-4fe7-ad61-a4951fd4f566 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:37.972722 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9338d21-9053-4fe7-ad61-a4951fd4f566 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:37.973151 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-c9338d21-9053-4fe7-ad61-a4951fd4f566 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:38.186215 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-c9338d21-9053-4fe7-ad61-a4951fd4f566 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:38.194588 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-c9338d21-9053-4fe7-ad61-a4951fd4f566 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1577 microversion: 2.1 time: 0.243414 Oct 27 09:46:38.195399 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 569/1149] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:37 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1577 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:39.178357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-d2d10eb4-1704-4aef-97b7-c0ebec9bbb21 req-d8606bde-28af-42fd-9d25-6bc7228b9c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b99fff6-5d91-4648-8384-6a57c8ee57b4", "name": "network-vif-deleted", "tag": "ba2ec990-d2bd-49f9-8c22-13fa6afdc1ee"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:39.189899 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-d2d10eb4-1704-4aef-97b7-c0ebec9bbb21 req-d8606bde-28af-42fd-9d25-6bc7228b9c83 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:39.190719 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-d2d10eb4-1704-4aef-97b7-c0ebec9bbb21 req-d8606bde-28af-42fd-9d25-6bc7228b9c83 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:39.191208 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-d2d10eb4-1704-4aef-97b7-c0ebec9bbb21 req-d8606bde-28af-42fd-9d25-6bc7228b9c83 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:39.204128 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-d2d10eb4-1704-4aef-97b7-c0ebec9bbb21 req-d8606bde-28af-42fd-9d25-6bc7228b9c83 service nova] Creating event network-vif-deleted:ba2ec990-d2bd-49f9-8c22-13fa6afdc1ee for instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 on hv-cinder-79797 Oct 27 09:46:39.209216 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-d2d10eb4-1704-4aef-97b7-c0ebec9bbb21 req-d8606bde-28af-42fd-9d25-6bc7228b9c83 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034681 Oct 27 09:46:39.209812 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 581/1150] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:39.220753 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1160049a-aa72-40f3-a914-54e0bcc43216 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:39.221499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1160049a-aa72-40f3-a914-54e0bcc43216 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:39.227962 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1160049a-aa72-40f3-a914-54e0bcc43216 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:39.228457 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1160049a-aa72-40f3-a914-54e0bcc43216 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:39.228919 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1160049a-aa72-40f3-a914-54e0bcc43216 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:39.229620 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1160049a-aa72-40f3-a914-54e0bcc43216 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:39.230063 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1160049a-aa72-40f3-a914-54e0bcc43216 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:39.230481 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1160049a-aa72-40f3-a914-54e0bcc43216 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:39.300563 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1160049a-aa72-40f3-a914-54e0bcc43216 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:39.308903 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1160049a-aa72-40f3-a914-54e0bcc43216 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 200 len: 1226 microversion: 2.1 time: 0.094592 Oct 27 09:46:39.309493 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 570/1151] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:39 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:40.333527 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:40.334224 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:40.340355 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:40.340872 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:40.341305 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:40.341987 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:40.342460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:40.342902 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:40.356033 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] HTTP exception thrown: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Request method failure captured: Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 HTTP/1.1 Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlLQIp-ucUOf18oo9M5d7kRoEr-ZZ7Dh-IfRCy33ywIFbyJdos7fpZ9sgU09ewHULz_GCyG2u7-BVSJPJNSWhF3XJ183FRJHoyZuy3XJqh3_edP210aFU826H1tpcn2se-7BjdhSXPatXdYsYaguEVR8klv8BjlCCUrsEchQ2U0F8kg Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 4ee2066bcc7240f9a63d5c11a2b04a18 Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:46:40.357612 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 4ee2066bcc7240f9a63d5c11a2b04a18 Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-TestVolumeBootPattern-1537325088-project Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 127c4fdd8f2b40ae8d98208d64a7f20d Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-TestVolumeBootPattern-1537325088-project Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:46:40.359720 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '4b99fff6-5d91-4648-8384-6a57c8ee57b4'} Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:46:40.360723 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:46:40.362327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:46:40.363735 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Returning 404 to user: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:46:40.363735 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-cc225865-4383-4a4a-bc76-80b768f6b9bc tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 404 len: 111 microversion: 2.1 time: 0.030763 Oct 27 09:46:40.363735 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 582/1152] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:40 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:46:40.454202 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-874828315", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1203524332", "security_groups": [{"name": "tempest-secgroup-smoke-375936574"}], "block_device_mapping_v2": [{"uuid": "83b9244c-2f04-47c8-8ae5-77d01cd7bd3c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29853958-4339-4761-9164-23edabe04a06"}]}} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:40.565325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.network.neutron [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] validate_networks() for [('29853958-4339-4761-9164-23edabe04a06', None, None, None, None, None)] {{(pid=125362) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:46:40.921676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Flavor limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:46:40.922042 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Image limits 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:46:40.922513 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Flavor pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:46:40.922980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Image pref 0:0:0 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:46:40.923396 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.virt.hardware [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:46:40.932027 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:40.932503 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:40.932966 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:40.933694 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:40.934150 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:40.934567 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:40.951475 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Getting quotas for project 4ee2066bcc7240f9a63d5c11a2b04a18. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:46:40.955971 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.quota [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Getting quotas for user 127c4fdd8f2b40ae8d98208d64a7f20d and project 4ee2066bcc7240f9a63d5c11a2b04a18. Resources: {'instances', 'ram', 'cores'} {{(pid=125362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:46:41.011766 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Going to run 1 instances... {{(pid=125362) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:46:41.013975 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='83b9244c-2f04-47c8-8ae5-77d01cd7bd3c',volume_size=None,volume_type=None)] {{(pid=125362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:46:41.142165 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-32d45688-e771-4f83-a15c-0f0104a8757e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691858 Oct 27 09:46:41.142821 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 571/1153] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:46:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:46:41.154257 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-595f9076-143f-405b-93d0-98004b7e1cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:41.154869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-595f9076-143f-405b-93d0-98004b7e1cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:41.214061 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-595f9076-143f-405b-93d0-98004b7e1cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:41.221604 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-595f9076-143f-405b-93d0-98004b7e1cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1094 microversion: 2.1 time: 0.071531 Oct 27 09:46:41.222170 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 583/1154] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:41 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:42.245062 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-7f045833-3472-407d-ad70-a07bde34d6e4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:42.245817 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-7f045833-3472-407d-ad70-a07bde34d6e4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:42.252141 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f045833-3472-407d-ad70-a07bde34d6e4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:42.252682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f045833-3472-407d-ad70-a07bde34d6e4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:42.253119 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f045833-3472-407d-ad70-a07bde34d6e4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:42.253827 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f045833-3472-407d-ad70-a07bde34d6e4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:42.254281 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f045833-3472-407d-ad70-a07bde34d6e4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:42.254703 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-7f045833-3472-407d-ad70-a07bde34d6e4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:42.324780 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-7f045833-3472-407d-ad70-a07bde34d6e4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:42.332868 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-7f045833-3472-407d-ad70-a07bde34d6e4 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1210 microversion: 2.1 time: 0.092110 Oct 27 09:46:42.333721 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 572/1155] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:42 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:43.357619 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-33a3ca68-86aa-430e-adce-f016a1b9b7fb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:43.358745 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-33a3ca68-86aa-430e-adce-f016a1b9b7fb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:43.366044 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-33a3ca68-86aa-430e-adce-f016a1b9b7fb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:43.366639 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-33a3ca68-86aa-430e-adce-f016a1b9b7fb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:43.367070 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-33a3ca68-86aa-430e-adce-f016a1b9b7fb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:43.367756 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-33a3ca68-86aa-430e-adce-f016a1b9b7fb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:43.368202 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-33a3ca68-86aa-430e-adce-f016a1b9b7fb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:43.369257 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-33a3ca68-86aa-430e-adce-f016a1b9b7fb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:43.526703 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-737571f3-4f93-49ed-a73a-d4a7ef28a108 req-14857bae-4ad9-4eb9-ba2a-7a56fc2b78d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be390996-dc4a-4a16-999e-2f9e829870ef", "tag": "e8788048-f682-4e10-853b-7d55b6d2595c"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:43.534263 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:46:43.534655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Thu Oct 27 09:46:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Oct 27 09:46:43.542857 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-737571f3-4f93-49ed-a73a-d4a7ef28a108 req-14857bae-4ad9-4eb9-ba2a-7a56fc2b78d5 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:43.543326 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-737571f3-4f93-49ed-a73a-d4a7ef28a108 req-14857bae-4ad9-4eb9-ba2a-7a56fc2b78d5 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:43.543756 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-737571f3-4f93-49ed-a73a-d4a7ef28a108 req-14857bae-4ad9-4eb9-ba2a-7a56fc2b78d5 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:43.555757 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-737571f3-4f93-49ed-a73a-d4a7ef28a108 req-14857bae-4ad9-4eb9-ba2a-7a56fc2b78d5 service nova] Creating event network-changed:e8788048-f682-4e10-853b-7d55b6d2595c for instance be390996-dc4a-4a16-999e-2f9e829870ef on hv-cinder-79797 Oct 27 09:46:43.560918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-737571f3-4f93-49ed-a73a-d4a7ef28a108 req-14857bae-4ad9-4eb9-ba2a-7a56fc2b78d5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038516 Oct 27 09:46:43.562073 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 573/1156] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 09:46:43.578702 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-33a3ca68-86aa-430e-adce-f016a1b9b7fb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:43.586585 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-33a3ca68-86aa-430e-adce-f016a1b9b7fb tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1265 microversion: 2.1 time: 0.232800 Oct 27 09:46:43.587161 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 584/1157] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:43 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:44.611451 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-1e193a48-c06d-4eec-869a-bab961a114db tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:44.612163 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-1e193a48-c06d-4eec-869a-bab961a114db tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:44.618350 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1e193a48-c06d-4eec-869a-bab961a114db tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:44.618831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1e193a48-c06d-4eec-869a-bab961a114db tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:44.619268 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1e193a48-c06d-4eec-869a-bab961a114db tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:44.619992 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1e193a48-c06d-4eec-869a-bab961a114db tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:44.620474 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1e193a48-c06d-4eec-869a-bab961a114db tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:44.620934 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-1e193a48-c06d-4eec-869a-bab961a114db tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:44.756812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-1e193a48-c06d-4eec-869a-bab961a114db tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:44.764377 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-1e193a48-c06d-4eec-869a-bab961a114db tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1265 microversion: 2.1 time: 0.157969 Oct 27 09:46:44.764965 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 574/1158] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:44 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:45.787138 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-af474f44-bfb8-46ec-9038-a7b201d2315b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:45.787759 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-af474f44-bfb8-46ec-9038-a7b201d2315b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:45.790366 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:46:45.790514 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Thu Oct 27 09:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef (ip 10.222.0.70) !!! Oct 27 09:46:45.798426 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-af474f44-bfb8-46ec-9038-a7b201d2315b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:45.798914 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-af474f44-bfb8-46ec-9038-a7b201d2315b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:45.799349 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-af474f44-bfb8-46ec-9038-a7b201d2315b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:45.800047 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-af474f44-bfb8-46ec-9038-a7b201d2315b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:45.800500 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-af474f44-bfb8-46ec-9038-a7b201d2315b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:45.800949 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-af474f44-bfb8-46ec-9038-a7b201d2315b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:45.935966 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-af474f44-bfb8-46ec-9038-a7b201d2315b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:45.944105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-af474f44-bfb8-46ec-9038-a7b201d2315b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1265 microversion: 2.1 time: 0.160879 Oct 27 09:46:45.944695 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 585/1159] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:45 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:46:46.966912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-99c8acc2-4a2d-4c62-ab91-3a39afe397f3 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:46.968192 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-99c8acc2-4a2d-4c62-ab91-3a39afe397f3 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:46.974545 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99c8acc2-4a2d-4c62-ab91-3a39afe397f3 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:46.975060 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99c8acc2-4a2d-4c62-ab91-3a39afe397f3 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:46.975505 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99c8acc2-4a2d-4c62-ab91-3a39afe397f3 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:46.976199 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99c8acc2-4a2d-4c62-ab91-3a39afe397f3 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:46.976684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99c8acc2-4a2d-4c62-ab91-3a39afe397f3 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:46.977112 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-99c8acc2-4a2d-4c62-ab91-3a39afe397f3 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:47.108696 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-99c8acc2-4a2d-4c62-ab91-3a39afe397f3 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:47.116372 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-99c8acc2-4a2d-4c62-ab91-3a39afe397f3 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1265 microversion: 2.1 time: 0.153331 Oct 27 09:46:47.116970 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 575/1160] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:46 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:48.138928 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-ff13bdb0-dcae-4ee1-9f85-49ffd1d21408 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:48.140125 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-ff13bdb0-dcae-4ee1-9f85-49ffd1d21408 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:48.146990 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff13bdb0-dcae-4ee1-9f85-49ffd1d21408 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:48.147116 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff13bdb0-dcae-4ee1-9f85-49ffd1d21408 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:48.147563 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff13bdb0-dcae-4ee1-9f85-49ffd1d21408 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:48.148295 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff13bdb0-dcae-4ee1-9f85-49ffd1d21408 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:48.148744 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff13bdb0-dcae-4ee1-9f85-49ffd1d21408 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:48.149163 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-ff13bdb0-dcae-4ee1-9f85-49ffd1d21408 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:48.277552 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-ff13bdb0-dcae-4ee1-9f85-49ffd1d21408 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:48.285670 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-ff13bdb0-dcae-4ee1-9f85-49ffd1d21408 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1265 microversion: 2.1 time: 0.150599 Oct 27 09:46:48.286240 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 586/1161] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:48 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:49.308965 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6b3446b7-3deb-4f85-91a8-028ef6177600 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:49.309585 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6b3446b7-3deb-4f85-91a8-028ef6177600 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:49.316951 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b3446b7-3deb-4f85-91a8-028ef6177600 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:49.317434 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b3446b7-3deb-4f85-91a8-028ef6177600 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:49.317869 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b3446b7-3deb-4f85-91a8-028ef6177600 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:49.318558 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b3446b7-3deb-4f85-91a8-028ef6177600 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:49.319012 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b3446b7-3deb-4f85-91a8-028ef6177600 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:49.319439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6b3446b7-3deb-4f85-91a8-028ef6177600 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:49.450149 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6b3446b7-3deb-4f85-91a8-028ef6177600 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:49.458350 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6b3446b7-3deb-4f85-91a8-028ef6177600 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1265 microversion: 2.1 time: 0.153316 Oct 27 09:46:49.458905 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 576/1162] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:49 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:50.483016 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2f45610a-ba9c-46fe-a278-71fed43301b6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:50.483620 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2f45610a-ba9c-46fe-a278-71fed43301b6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:50.490247 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2f45610a-ba9c-46fe-a278-71fed43301b6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:50.490731 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2f45610a-ba9c-46fe-a278-71fed43301b6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:50.491169 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2f45610a-ba9c-46fe-a278-71fed43301b6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:50.491864 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2f45610a-ba9c-46fe-a278-71fed43301b6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:50.492318 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2f45610a-ba9c-46fe-a278-71fed43301b6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:50.492780 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2f45610a-ba9c-46fe-a278-71fed43301b6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:50.620929 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2f45610a-ba9c-46fe-a278-71fed43301b6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:50.629167 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2f45610a-ba9c-46fe-a278-71fed43301b6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1265 microversion: 2.1 time: 0.149967 Oct 27 09:46:50.629733 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 587/1163] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:50 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:51.651299 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-437877c4-0524-4c82-818c-ebac07ec4465 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:51.651895 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-437877c4-0524-4c82-818c-ebac07ec4465 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:51.654352 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:51.655675 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=6 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:51.661358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-437877c4-0524-4c82-818c-ebac07ec4465 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:51.661849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-437877c4-0524-4c82-818c-ebac07ec4465 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:51.662290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-437877c4-0524-4c82-818c-ebac07ec4465 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:51.662988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-437877c4-0524-4c82-818c-ebac07ec4465 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:51.663444 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-437877c4-0524-4c82-818c-ebac07ec4465 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:51.663872 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-437877c4-0524-4c82-818c-ebac07ec4465 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:51.796628 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-437877c4-0524-4c82-818c-ebac07ec4465 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:51.804312 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-437877c4-0524-4c82-818c-ebac07ec4465 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1265 microversion: 2.1 time: 0.157000 Oct 27 09:46:51.804978 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 577/1164] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:51 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:52.827600 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d999ab48-bf0c-4970-8d15-d9624b31990b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:52.828142 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d999ab48-bf0c-4970-8d15-d9624b31990b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:52.830014 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:46:52.835575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d999ab48-bf0c-4970-8d15-d9624b31990b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:52.836051 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d999ab48-bf0c-4970-8d15-d9624b31990b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:52.836487 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d999ab48-bf0c-4970-8d15-d9624b31990b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:52.837192 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d999ab48-bf0c-4970-8d15-d9624b31990b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:52.837639 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d999ab48-bf0c-4970-8d15-d9624b31990b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:52.838059 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d999ab48-bf0c-4970-8d15-d9624b31990b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:52.969353 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d999ab48-bf0c-4970-8d15-d9624b31990b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:52.976831 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d999ab48-bf0c-4970-8d15-d9624b31990b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1265 microversion: 2.1 time: 0.153642 Oct 27 09:46:52.977398 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 588/1165] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:52 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:53.441812 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-9033eeee-3f1e-49fc-83f7-30111b48773a req-68f726c6-8f37-4346-9c73-60cd433c528c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be390996-dc4a-4a16-999e-2f9e829870ef", "name": "network-vif-plugged", "status": "completed", "tag": "e8788048-f682-4e10-853b-7d55b6d2595c"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:53.452658 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9033eeee-3f1e-49fc-83f7-30111b48773a req-68f726c6-8f37-4346-9c73-60cd433c528c service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:53.453370 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9033eeee-3f1e-49fc-83f7-30111b48773a req-68f726c6-8f37-4346-9c73-60cd433c528c service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:53.453580 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-9033eeee-3f1e-49fc-83f7-30111b48773a req-68f726c6-8f37-4346-9c73-60cd433c528c service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:53.465471 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-9033eeee-3f1e-49fc-83f7-30111b48773a req-68f726c6-8f37-4346-9c73-60cd433c528c service nova] Creating event network-vif-plugged:e8788048-f682-4e10-853b-7d55b6d2595c for instance be390996-dc4a-4a16-999e-2f9e829870ef on hv-cinder-79797 Oct 27 09:46:53.470435 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-9033eeee-3f1e-49fc-83f7-30111b48773a req-68f726c6-8f37-4346-9c73-60cd433c528c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032464 Oct 27 09:46:53.471287 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 578/1166] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:46:53.999760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-db9b0bc9-4f07-4d54-8d91-a392eae56e9d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:54.000280 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-db9b0bc9-4f07-4d54-8d91-a392eae56e9d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:54.006714 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db9b0bc9-4f07-4d54-8d91-a392eae56e9d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:54.007197 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db9b0bc9-4f07-4d54-8d91-a392eae56e9d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:54.007634 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db9b0bc9-4f07-4d54-8d91-a392eae56e9d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:54.008324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db9b0bc9-4f07-4d54-8d91-a392eae56e9d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:54.008807 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db9b0bc9-4f07-4d54-8d91-a392eae56e9d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:54.009236 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-db9b0bc9-4f07-4d54-8d91-a392eae56e9d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:54.142090 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-db9b0bc9-4f07-4d54-8d91-a392eae56e9d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:54.149847 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-db9b0bc9-4f07-4d54-8d91-a392eae56e9d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1265 microversion: 2.1 time: 0.154528 Oct 27 09:46:54.150430 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 589/1167] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:53 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:55.173918 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-27d66ed9-17d1-4474-aa24-b6044c62640d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:55.174624 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-27d66ed9-17d1-4474-aa24-b6044c62640d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:55.180789 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d66ed9-17d1-4474-aa24-b6044c62640d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:55.181272 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d66ed9-17d1-4474-aa24-b6044c62640d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:55.181712 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d66ed9-17d1-4474-aa24-b6044c62640d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:55.182410 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d66ed9-17d1-4474-aa24-b6044c62640d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:55.182863 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d66ed9-17d1-4474-aa24-b6044c62640d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:55.183290 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-27d66ed9-17d1-4474-aa24-b6044c62640d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:55.313017 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-27d66ed9-17d1-4474-aa24-b6044c62640d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:55.320983 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-27d66ed9-17d1-4474-aa24-b6044c62640d tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1451 microversion: 2.1 time: 0.152256 Oct 27 09:46:55.321556 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 579/1168] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:55 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:55.342806 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-4b286b33-dd6d-464d-8e87-2c42cade11a9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:46:55.343425 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-4b286b33-dd6d-464d-8e87-2c42cade11a9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:46:55.349871 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b286b33-dd6d-464d-8e87-2c42cade11a9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:55.350357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b286b33-dd6d-464d-8e87-2c42cade11a9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:55.350792 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b286b33-dd6d-464d-8e87-2c42cade11a9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:55.351479 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b286b33-dd6d-464d-8e87-2c42cade11a9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:55.351934 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b286b33-dd6d-464d-8e87-2c42cade11a9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:55.352386 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-4b286b33-dd6d-464d-8e87-2c42cade11a9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:55.482771 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-4b286b33-dd6d-464d-8e87-2c42cade11a9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:46:55.490454 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-4b286b33-dd6d-464d-8e87-2c42cade11a9 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1451 microversion: 2.1 time: 0.151556 Oct 27 09:46:55.491022 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 590/1169] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:46:55 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:46:57.259006 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-a0a8ebd7-05d0-4fd5-bbf1-97163d35d146 req-39070345-3f7e-47d1-a377-383120bd8343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be390996-dc4a-4a16-999e-2f9e829870ef", "tag": "e8788048-f682-4e10-853b-7d55b6d2595c"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:46:57.268099 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a0a8ebd7-05d0-4fd5-bbf1-97163d35d146 req-39070345-3f7e-47d1-a377-383120bd8343 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:46:57.268582 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a0a8ebd7-05d0-4fd5-bbf1-97163d35d146 req-39070345-3f7e-47d1-a377-383120bd8343 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:46:57.269009 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-a0a8ebd7-05d0-4fd5-bbf1-97163d35d146 req-39070345-3f7e-47d1-a377-383120bd8343 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:46:57.280600 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-a0a8ebd7-05d0-4fd5-bbf1-97163d35d146 req-39070345-3f7e-47d1-a377-383120bd8343 service nova] Creating event network-changed:e8788048-f682-4e10-853b-7d55b6d2595c for instance be390996-dc4a-4a16-999e-2f9e829870ef on hv-cinder-79797 Oct 27 09:46:57.285441 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-a0a8ebd7-05d0-4fd5-bbf1-97163d35d146 req-39070345-3f7e-47d1-a377-383120bd8343 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030566 Oct 27 09:46:57.286718 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 580/1170] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:32.305605 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=24 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:32.306357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=52 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:32.311113 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1590020127", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1203524332", "security_groups": [{"name": "tempest-secgroup-smoke-375936574"}], "block_device_mapping_v2": [{"uuid": "f8066425-80ca-41b0-9682-aacc8f518353", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "29853958-4339-4761-9164-23edabe04a06"}]}} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:32.426323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.network.neutron [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] validate_networks() for [('29853958-4339-4761-9164-23edabe04a06', None, None, None, None, None)] {{(pid=125361) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 09:48:32.840951 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Flavor limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 09:48:32.841431 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Image limits 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 09:48:32.841904 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Flavor pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 09:48:32.842309 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Image pref 0:0:0 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 09:48:32.842718 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.virt.hardware [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125361) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 09:48:32.852205 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.852661 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.853096 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.853818 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:32.854271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:32.854696 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:32.871317 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Getting quotas for project 4ee2066bcc7240f9a63d5c11a2b04a18. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 09:48:32.875253 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.quota [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Getting quotas for user 127c4fdd8f2b40ae8d98208d64a7f20d and project 4ee2066bcc7240f9a63d5c11a2b04a18. Resources: {'instances', 'ram', 'cores'} {{(pid=125361) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 09:48:32.930742 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Going to run 1 instances... {{(pid=125361) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 09:48:32.932948 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8066425-80ca-41b0-9682-aacc8f518353',volume_size=None,volume_type=None)] {{(pid=125361) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 09:48:33.058503 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9e14a4cb-5bb9-4b2f-b2d5-a6d2ac843cff tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.754583 Oct 27 09:48:33.059151 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 591/1171] 10.222.0.70 () {60 vars in 1147 bytes} [Thu Oct 27 09:48:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 09:48:33.069116 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:33.069881 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:33.078567 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a42c6af7-2ef4-400b-8da0-ad0bc5ffca77 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:33.079279 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a42c6af7-2ef4-400b-8da0-ad0bc5ffca77 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:33.145500 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a42c6af7-2ef4-400b-8da0-ad0bc5ffca77 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:33.152238 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a42c6af7-2ef4-400b-8da0-ad0bc5ffca77 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1095 microversion: 2.1 time: 0.085819 Oct 27 09:48:33.153439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 581/1172] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:33 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1095 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:34.176159 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-c0f8bd5e-e056-47eb-87e4-97ad725d6dd1 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:34.176781 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-c0f8bd5e-e056-47eb-87e4-97ad725d6dd1 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:34.183680 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0f8bd5e-e056-47eb-87e4-97ad725d6dd1 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:34.184167 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0f8bd5e-e056-47eb-87e4-97ad725d6dd1 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:34.184634 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0f8bd5e-e056-47eb-87e4-97ad725d6dd1 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:34.185327 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0f8bd5e-e056-47eb-87e4-97ad725d6dd1 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:34.185781 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0f8bd5e-e056-47eb-87e4-97ad725d6dd1 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:34.186210 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-c0f8bd5e-e056-47eb-87e4-97ad725d6dd1 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:34.266701 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-c0f8bd5e-e056-47eb-87e4-97ad725d6dd1 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:34.275200 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-c0f8bd5e-e056-47eb-87e4-97ad725d6dd1 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1211 microversion: 2.1 time: 0.103668 Oct 27 09:48:34.276071 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 592/1173] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:34 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:35.298418 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d65a7526-1793-4402-bcd2-c1c2c414f448 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:35.299568 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d65a7526-1793-4402-bcd2-c1c2c414f448 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:35.306831 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d65a7526-1793-4402-bcd2-c1c2c414f448 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:35.307323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d65a7526-1793-4402-bcd2-c1c2c414f448 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:35.307764 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d65a7526-1793-4402-bcd2-c1c2c414f448 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:35.308466 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d65a7526-1793-4402-bcd2-c1c2c414f448 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:35.308956 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d65a7526-1793-4402-bcd2-c1c2c414f448 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:35.309385 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d65a7526-1793-4402-bcd2-c1c2c414f448 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:35.509221 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d65a7526-1793-4402-bcd2-c1c2c414f448 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:35.517697 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d65a7526-1793-4402-bcd2-c1c2c414f448 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.223180 Oct 27 09:48:35.518399 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 582/1174] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:35 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:35.665442 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-2b3cc498-e528-4577-9ee4-8c97786c59a6 req-066dd1ef-9c47-4c2a-b101-355f1a4895cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898652a4-3e08-45f7-a331-888e7dec6188", "tag": "f83a1add-bf69-422d-944a-4ac8ffc897f2"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:35.675012 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-2b3cc498-e528-4577-9ee4-8c97786c59a6 req-066dd1ef-9c47-4c2a-b101-355f1a4895cc service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:35.675495 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-2b3cc498-e528-4577-9ee4-8c97786c59a6 req-066dd1ef-9c47-4c2a-b101-355f1a4895cc service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:35.675927 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-2b3cc498-e528-4577-9ee4-8c97786c59a6 req-066dd1ef-9c47-4c2a-b101-355f1a4895cc service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:35.686796 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-2b3cc498-e528-4577-9ee4-8c97786c59a6 req-066dd1ef-9c47-4c2a-b101-355f1a4895cc service nova] Creating event network-changed:f83a1add-bf69-422d-944a-4ac8ffc897f2 for instance 898652a4-3e08-45f7-a331-888e7dec6188 on hv-cinder-79797 Oct 27 09:48:35.692238 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-2b3cc498-e528-4577-9ee4-8c97786c59a6 req-066dd1ef-9c47-4c2a-b101-355f1a4895cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097183 Oct 27 09:48:35.692869 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 593/1175] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:36.541358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-75164b76-9439-4f36-875a-35affa92acbf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:36.541967 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-75164b76-9439-4f36-875a-35affa92acbf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:36.548362 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75164b76-9439-4f36-875a-35affa92acbf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:36.548871 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75164b76-9439-4f36-875a-35affa92acbf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:36.549306 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75164b76-9439-4f36-875a-35affa92acbf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:36.550630 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75164b76-9439-4f36-875a-35affa92acbf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:36.551079 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75164b76-9439-4f36-875a-35affa92acbf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:36.551506 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-75164b76-9439-4f36-875a-35affa92acbf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:36.770024 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-75164b76-9439-4f36-875a-35affa92acbf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:36.777950 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-75164b76-9439-4f36-875a-35affa92acbf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.240561 Oct 27 09:48:36.778514 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 583/1176] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:36 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:37.801711 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-de42e07e-2b90-4b02-b517-65095a955821 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:37.802434 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-de42e07e-2b90-4b02-b517-65095a955821 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:37.808491 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de42e07e-2b90-4b02-b517-65095a955821 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:37.808998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de42e07e-2b90-4b02-b517-65095a955821 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:37.809428 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de42e07e-2b90-4b02-b517-65095a955821 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:37.810098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de42e07e-2b90-4b02-b517-65095a955821 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:37.810545 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de42e07e-2b90-4b02-b517-65095a955821 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:37.810959 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-de42e07e-2b90-4b02-b517-65095a955821 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:37.938451 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-de42e07e-2b90-4b02-b517-65095a955821 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:37.946783 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-de42e07e-2b90-4b02-b517-65095a955821 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.150005 Oct 27 09:48:37.947357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 594/1177] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:37 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:38.969855 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-fb5706f8-3470-4799-93a8-0c04c5614e53 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:38.970494 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-fb5706f8-3470-4799-93a8-0c04c5614e53 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:38.976988 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb5706f8-3470-4799-93a8-0c04c5614e53 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:38.977469 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb5706f8-3470-4799-93a8-0c04c5614e53 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:38.977923 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb5706f8-3470-4799-93a8-0c04c5614e53 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:38.978600 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb5706f8-3470-4799-93a8-0c04c5614e53 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:38.979051 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb5706f8-3470-4799-93a8-0c04c5614e53 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:38.979474 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-fb5706f8-3470-4799-93a8-0c04c5614e53 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:39.110277 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-fb5706f8-3470-4799-93a8-0c04c5614e53 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:39.117843 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-fb5706f8-3470-4799-93a8-0c04c5614e53 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.152016 Oct 27 09:48:39.118412 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 584/1178] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:38 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:40.140505 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-586f0daf-ebee-4013-84b2-e83225f0c2ba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:40.141158 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-586f0daf-ebee-4013-84b2-e83225f0c2ba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:40.147169 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-586f0daf-ebee-4013-84b2-e83225f0c2ba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:40.147652 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-586f0daf-ebee-4013-84b2-e83225f0c2ba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:40.148092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-586f0daf-ebee-4013-84b2-e83225f0c2ba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:40.148806 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-586f0daf-ebee-4013-84b2-e83225f0c2ba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:40.149259 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-586f0daf-ebee-4013-84b2-e83225f0c2ba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:40.149687 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-586f0daf-ebee-4013-84b2-e83225f0c2ba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:40.277843 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-586f0daf-ebee-4013-84b2-e83225f0c2ba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:40.286306 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-586f0daf-ebee-4013-84b2-e83225f0c2ba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.149670 Oct 27 09:48:40.286741 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 595/1179] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:40 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:41.308974 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-14260bb8-a8bb-45e2-9db0-b48308e3d71b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:41.309586 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-14260bb8-a8bb-45e2-9db0-b48308e3d71b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:41.316629 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14260bb8-a8bb-45e2-9db0-b48308e3d71b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:41.317111 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14260bb8-a8bb-45e2-9db0-b48308e3d71b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:41.317543 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14260bb8-a8bb-45e2-9db0-b48308e3d71b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:41.318226 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14260bb8-a8bb-45e2-9db0-b48308e3d71b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:41.318676 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14260bb8-a8bb-45e2-9db0-b48308e3d71b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:41.319098 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-14260bb8-a8bb-45e2-9db0-b48308e3d71b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:41.448759 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-14260bb8-a8bb-45e2-9db0-b48308e3d71b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:41.456317 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-14260bb8-a8bb-45e2-9db0-b48308e3d71b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.151276 Oct 27 09:48:41.456910 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 585/1180] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:41 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:42.478788 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-2c02979d-3ecc-43d2-be74-378de6137a07 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:42.479360 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-2c02979d-3ecc-43d2-be74-378de6137a07 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:42.485840 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2c02979d-3ecc-43d2-be74-378de6137a07 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:42.486321 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2c02979d-3ecc-43d2-be74-378de6137a07 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:42.486755 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2c02979d-3ecc-43d2-be74-378de6137a07 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:42.487444 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2c02979d-3ecc-43d2-be74-378de6137a07 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:42.487899 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2c02979d-3ecc-43d2-be74-378de6137a07 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:42.488323 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-2c02979d-3ecc-43d2-be74-378de6137a07 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:42.616025 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-2c02979d-3ecc-43d2-be74-378de6137a07 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:42.623669 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-2c02979d-3ecc-43d2-be74-378de6137a07 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.148883 Oct 27 09:48:42.624234 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 596/1181] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:42 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:43.646682 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-46423a0b-1325-4e29-9e7b-2f633f49b01e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:43.647310 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-46423a0b-1325-4e29-9e7b-2f633f49b01e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:43.649664 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell0:SELECT=2 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:43.654892 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46423a0b-1325-4e29-9e7b-2f633f49b01e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:43.655380 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46423a0b-1325-4e29-9e7b-2f633f49b01e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:43.655822 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46423a0b-1325-4e29-9e7b-2f633f49b01e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:43.656543 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46423a0b-1325-4e29-9e7b-2f633f49b01e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:43.657011 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46423a0b-1325-4e29-9e7b-2f633f49b01e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:43.657439 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-46423a0b-1325-4e29-9e7b-2f633f49b01e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:43.783739 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-46423a0b-1325-4e29-9e7b-2f633f49b01e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:43.791995 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-46423a0b-1325-4e29-9e7b-2f633f49b01e tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.149250 Oct 27 09:48:43.792572 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 586/1182] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:43 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:44.815132 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-40a5b90f-a982-4a4b-82ed-dad6e8dd931c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:44.816344 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-40a5b90f-a982-4a4b-82ed-dad6e8dd931c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:44.818375 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=2 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:44.819049 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell0:SELECT=6 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:48:44.826292 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-40a5b90f-a982-4a4b-82ed-dad6e8dd931c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:44.826906 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-40a5b90f-a982-4a4b-82ed-dad6e8dd931c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:44.827349 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-40a5b90f-a982-4a4b-82ed-dad6e8dd931c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:44.828055 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-40a5b90f-a982-4a4b-82ed-dad6e8dd931c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:44.828509 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-40a5b90f-a982-4a4b-82ed-dad6e8dd931c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:44.829239 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-40a5b90f-a982-4a4b-82ed-dad6e8dd931c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:45.290271 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-40a5b90f-a982-4a4b-82ed-dad6e8dd931c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:45.297845 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-40a5b90f-a982-4a4b-82ed-dad6e8dd931c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.486647 Oct 27 09:48:45.298604 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 597/1183] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:44 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:46.144718 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [req-c26e13b7-26df-465b-b213-1bd779e54729 req-b1127652-1bad-4c04-af9e-2c68ee64288d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898652a4-3e08-45f7-a331-888e7dec6188", "name": "network-vif-plugged", "status": "completed", "tag": "f83a1add-bf69-422d-944a-4ac8ffc897f2"}]} {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:46.154336 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-c26e13b7-26df-465b-b213-1bd779e54729 req-b1127652-1bad-4c04-af9e-2c68ee64288d service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:46.154816 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-c26e13b7-26df-465b-b213-1bd779e54729 req-b1127652-1bad-4c04-af9e-2c68ee64288d service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:46.155250 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [req-c26e13b7-26df-465b-b213-1bd779e54729 req-b1127652-1bad-4c04-af9e-2c68ee64288d service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:46.166639 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.compute.server_external_events [req-c26e13b7-26df-465b-b213-1bd779e54729 req-b1127652-1bad-4c04-af9e-2c68ee64288d service nova] Creating event network-vif-plugged:f83a1add-bf69-422d-944a-4ac8ffc897f2 for instance 898652a4-3e08-45f7-a331-888e7dec6188 on hv-cinder-79797 Oct 27 09:48:46.171842 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [req-c26e13b7-26df-465b-b213-1bd779e54729 req-b1127652-1bad-4c04-af9e-2c68ee64288d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091435 Oct 27 09:48:46.172551 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 587/1184] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:48:46.322000 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-b75dbabf-c508-46b7-afa0-438fd0d21abd tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:46.323012 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-b75dbabf-c508-46b7-afa0-438fd0d21abd tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:46.329849 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b75dbabf-c508-46b7-afa0-438fd0d21abd tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:46.330339 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b75dbabf-c508-46b7-afa0-438fd0d21abd tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:46.330778 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b75dbabf-c508-46b7-afa0-438fd0d21abd tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:46.332093 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b75dbabf-c508-46b7-afa0-438fd0d21abd tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:46.333278 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b75dbabf-c508-46b7-afa0-438fd0d21abd tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:46.333764 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-b75dbabf-c508-46b7-afa0-438fd0d21abd tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:46.509748 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-b75dbabf-c508-46b7-afa0-438fd0d21abd tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:46.517733 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-b75dbabf-c508-46b7-afa0-438fd0d21abd tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.201041 Oct 27 09:48:46.519465 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 598/1185] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:46 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:47.542745 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-ecee11eb-6ca7-49b1-8b86-0aa87b8a2bba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:47.543378 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-ecee11eb-6ca7-49b1-8b86-0aa87b8a2bba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:47.549573 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ecee11eb-6ca7-49b1-8b86-0aa87b8a2bba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:47.550657 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ecee11eb-6ca7-49b1-8b86-0aa87b8a2bba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:47.551091 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ecee11eb-6ca7-49b1-8b86-0aa87b8a2bba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:47.551786 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ecee11eb-6ca7-49b1-8b86-0aa87b8a2bba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:47.552224 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ecee11eb-6ca7-49b1-8b86-0aa87b8a2bba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:47.552669 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-ecee11eb-6ca7-49b1-8b86-0aa87b8a2bba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:47.681499 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-ecee11eb-6ca7-49b1-8b86-0aa87b8a2bba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:47.689208 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-ecee11eb-6ca7-49b1-8b86-0aa87b8a2bba tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1266 microversion: 2.1 time: 0.151292 Oct 27 09:48:47.689778 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 588/1186] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:47 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:48.711272 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-e90dfad0-6560-4c25-a381-df22ffa08a3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:48.711919 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-e90dfad0-6560-4c25-a381-df22ffa08a3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:48.718393 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e90dfad0-6560-4c25-a381-df22ffa08a3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:48.718876 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e90dfad0-6560-4c25-a381-df22ffa08a3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:48.719312 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e90dfad0-6560-4c25-a381-df22ffa08a3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:48.719997 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e90dfad0-6560-4c25-a381-df22ffa08a3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:48.720449 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e90dfad0-6560-4c25-a381-df22ffa08a3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:48.720900 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-e90dfad0-6560-4c25-a381-df22ffa08a3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:48.853995 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-e90dfad0-6560-4c25-a381-df22ffa08a3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:48.863281 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-e90dfad0-6560-4c25-a381-df22ffa08a3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1452 microversion: 2.1 time: 0.154405 Oct 27 09:48:48.863857 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 599/1187] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:48 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:48.885512 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-a5bdcb11-7fc7-4d50-a621-4447adb68472 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:48:48.886258 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-a5bdcb11-7fc7-4d50-a621-4447adb68472 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:48:48.893243 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5bdcb11-7fc7-4d50-a621-4447adb68472 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:48.893738 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5bdcb11-7fc7-4d50-a621-4447adb68472 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:48.894177 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5bdcb11-7fc7-4d50-a621-4447adb68472 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:48.894889 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5bdcb11-7fc7-4d50-a621-4447adb68472 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:48.895347 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5bdcb11-7fc7-4d50-a621-4447adb68472 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:48.895775 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-a5bdcb11-7fc7-4d50-a621-4447adb68472 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:49.022325 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-a5bdcb11-7fc7-4d50-a621-4447adb68472 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:48:49.030082 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-a5bdcb11-7fc7-4d50-a621-4447adb68472 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1452 microversion: 2.1 time: 0.148383 Oct 27 09:48:49.030655 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 589/1188] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:48:48 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:48:50.882404 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-9a5b34b1-1a18-46cd-9e4d-813dc664ddb6 req-9ad097fc-8ffd-4336-8f06-0aaa35d5ac5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898652a4-3e08-45f7-a331-888e7dec6188", "tag": "f83a1add-bf69-422d-944a-4ac8ffc897f2"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:48:50.891703 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-9a5b34b1-1a18-46cd-9e4d-813dc664ddb6 req-9ad097fc-8ffd-4336-8f06-0aaa35d5ac5a service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:48:50.892182 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-9a5b34b1-1a18-46cd-9e4d-813dc664ddb6 req-9ad097fc-8ffd-4336-8f06-0aaa35d5ac5a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:48:50.892666 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-9a5b34b1-1a18-46cd-9e4d-813dc664ddb6 req-9ad097fc-8ffd-4336-8f06-0aaa35d5ac5a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:48:50.904155 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-9a5b34b1-1a18-46cd-9e4d-813dc664ddb6 req-9ad097fc-8ffd-4336-8f06-0aaa35d5ac5a service nova] Creating event network-changed:f83a1add-bf69-422d-944a-4ac8ffc897f2 for instance 898652a4-3e08-45f7-a331-888e7dec6188 on hv-cinder-79797 Oct 27 09:48:50.909247 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-9a5b34b1-1a18-46cd-9e4d-813dc664ddb6 req-9ad097fc-8ffd-4336-8f06-0aaa35d5ac5a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085180 Oct 27 09:48:50.910400 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 600/1189] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:50:13.908783 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-64c64c1d-4285-4efd-99b7-239664274cca tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:13.909333 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:13.909717 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-64c64c1d-4285-4efd-99b7-239664274cca tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:13.910642 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG dbcounter [-] [125361] Writing DB stats nova_cell1:SELECT=48 {{(pid=125361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:13.911828 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_api:SELECT=20 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:13.912351 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:50:13.912489 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Thu Oct 27 09:50:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Oct 27 09:50:13.912622 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG dbcounter [-] [125362] Writing DB stats nova_cell1:SELECT=44 {{(pid=125362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 09:50:13.913843 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:50:13.913986 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Thu Oct 27 09:50:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 (ip 10.222.0.70) !!! Oct 27 09:50:13.916984 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 09:50:13.917662 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Thu Oct 27 09:50:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 (ip 10.222.0.70) !!! Oct 27 09:50:13.928222 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64c64c1d-4285-4efd-99b7-239664274cca tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:13.928991 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64c64c1d-4285-4efd-99b7-239664274cca tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:13.929498 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64c64c1d-4285-4efd-99b7-239664274cca tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:13.930282 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64c64c1d-4285-4efd-99b7-239664274cca tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:13.930460 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-6e50ffc6-4616-4bf9-8aa1-2ab779ce7294 req-1184bbe3-2fbc-419c-b315-ab21ad25f22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "898652a4-3e08-45f7-a331-888e7dec6188", "tag": "f83a1add-bf69-422d-944a-4ac8ffc897f2"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:13.930858 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64c64c1d-4285-4efd-99b7-239664274cca tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:13.931375 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-64c64c1d-4285-4efd-99b7-239664274cca tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:13.944970 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-6e50ffc6-4616-4bf9-8aa1-2ab779ce7294 req-1184bbe3-2fbc-419c-b315-ab21ad25f22a service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:13.945454 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-6e50ffc6-4616-4bf9-8aa1-2ab779ce7294 req-1184bbe3-2fbc-419c-b315-ab21ad25f22a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:13.946081 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-6e50ffc6-4616-4bf9-8aa1-2ab779ce7294 req-1184bbe3-2fbc-419c-b315-ab21ad25f22a service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:13.958006 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-6e50ffc6-4616-4bf9-8aa1-2ab779ce7294 req-1184bbe3-2fbc-419c-b315-ab21ad25f22a service nova] Creating event network-changed:f83a1add-bf69-422d-944a-4ac8ffc897f2 for instance 898652a4-3e08-45f7-a331-888e7dec6188 on hv-cinder-79797 Oct 27 09:50:13.963775 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-6e50ffc6-4616-4bf9-8aa1-2ab779ce7294 req-1184bbe3-2fbc-419c-b315-ab21ad25f22a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057235 Oct 27 09:50:13.964014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-64c64c1d-4285-4efd-99b7-239664274cca tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:50:13.964365 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 601/1190] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:50:14.055422 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-64c64c1d-4285-4efd-99b7-239664274cca tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "DELETE /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 204 len: 0 microversion: 2.1 time: 0.151296 Oct 27 09:50:14.059369 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 590/1191] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:50:13 2022] DELETE /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:50:14.066456 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-9c84d122-e998-4380-acc2-d9a6312a45a6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:14.067056 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-9c84d122-e998-4380-acc2-d9a6312a45a6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:14.078366 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c84d122-e998-4380-acc2-d9a6312a45a6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:14.078748 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c84d122-e998-4380-acc2-d9a6312a45a6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:14.079284 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c84d122-e998-4380-acc2-d9a6312a45a6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:14.079998 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c84d122-e998-4380-acc2-d9a6312a45a6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:14.080659 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c84d122-e998-4380-acc2-d9a6312a45a6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:14.081112 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-9c84d122-e998-4380-acc2-d9a6312a45a6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:14.234707 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-9c84d122-e998-4380-acc2-d9a6312a45a6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:14.243105 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-9c84d122-e998-4380-acc2-d9a6312a45a6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1577 microversion: 2.1 time: 0.181913 Oct 27 09:50:14.243683 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 602/1192] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:14 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:15.267763 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-4cf78449-334d-4030-96e5-6bd4cdf48a7f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:15.268398 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-4cf78449-334d-4030-96e5-6bd4cdf48a7f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:15.275131 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4cf78449-334d-4030-96e5-6bd4cdf48a7f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:15.275617 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4cf78449-334d-4030-96e5-6bd4cdf48a7f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:15.276050 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4cf78449-334d-4030-96e5-6bd4cdf48a7f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:15.276779 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4cf78449-334d-4030-96e5-6bd4cdf48a7f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:15.277228 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4cf78449-334d-4030-96e5-6bd4cdf48a7f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:15.277643 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-4cf78449-334d-4030-96e5-6bd4cdf48a7f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:15.413670 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-4cf78449-334d-4030-96e5-6bd4cdf48a7f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:15.421960 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-4cf78449-334d-4030-96e5-6bd4cdf48a7f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1577 microversion: 2.1 time: 0.158549 Oct 27 09:50:15.422576 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 591/1193] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:15 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:16.198989 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-626b2c60-179f-4e69-9169-e7515db859a3 req-abbcee9f-448c-40c2-a573-bc1595293d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "898652a4-3e08-45f7-a331-888e7dec6188", "name": "network-vif-deleted", "tag": "f83a1add-bf69-422d-944a-4ac8ffc897f2"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:16.209348 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-626b2c60-179f-4e69-9169-e7515db859a3 req-abbcee9f-448c-40c2-a573-bc1595293d85 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:16.209826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-626b2c60-179f-4e69-9169-e7515db859a3 req-abbcee9f-448c-40c2-a573-bc1595293d85 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:16.210825 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-626b2c60-179f-4e69-9169-e7515db859a3 req-abbcee9f-448c-40c2-a573-bc1595293d85 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:16.222760 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-626b2c60-179f-4e69-9169-e7515db859a3 req-abbcee9f-448c-40c2-a573-bc1595293d85 service nova] Creating event network-vif-deleted:f83a1add-bf69-422d-944a-4ac8ffc897f2 for instance 898652a4-3e08-45f7-a331-888e7dec6188 on hv-cinder-79797 Oct 27 09:50:16.227759 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-626b2c60-179f-4e69-9169-e7515db859a3 req-abbcee9f-448c-40c2-a573-bc1595293d85 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032967 Oct 27 09:50:16.228357 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 603/1194] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:50:16.445447 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-03d2a697-0239-47ad-bcf8-17e93b43e8e5 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:16.446055 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-03d2a697-0239-47ad-bcf8-17e93b43e8e5 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:16.452702 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-03d2a697-0239-47ad-bcf8-17e93b43e8e5 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:16.453188 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-03d2a697-0239-47ad-bcf8-17e93b43e8e5 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:16.453624 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-03d2a697-0239-47ad-bcf8-17e93b43e8e5 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:16.454316 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-03d2a697-0239-47ad-bcf8-17e93b43e8e5 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:16.454766 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-03d2a697-0239-47ad-bcf8-17e93b43e8e5 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:16.455186 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-03d2a697-0239-47ad-bcf8-17e93b43e8e5 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:16.527365 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-03d2a697-0239-47ad-bcf8-17e93b43e8e5 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:16.535951 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-03d2a697-0239-47ad-bcf8-17e93b43e8e5 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 200 len: 1226 microversion: 2.1 time: 0.094722 Oct 27 09:50:16.536684 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 592/1195] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:16 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:17.559884 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:17.560499 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 898652a4-3e08-45f7-a331-888e7dec6188] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:17.567210 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:17.567691 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:17.568123 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:17.568838 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:17.569293 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:17.570221 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:17.583536 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] HTTP exception thrown: Instance 898652a4-3e08-45f7-a331-888e7dec6188 could not be found. Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Request method failure captured: Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 HTTP/1.1 Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlLQIp-ucUOf18oo9M5d7kRoEr-ZZ7Dh-IfRCy33ywIFbyJdos7fpZ9sgU09ewHULz_GCyG2u7-BVSJPJNSWhF3XJ183FRJHoyZuy3XJqh3_edP210aFU826H1tpcn2se-7BjdhSXPatXdYsYaguEVR8klv8BjlCCUrsEchQ2U0F8kg Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 4ee2066bcc7240f9a63d5c11a2b04a18 Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:50:17.585826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 4ee2066bcc7240f9a63d5c11a2b04a18 Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-TestVolumeBootPattern-1537325088-project Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 127c4fdd8f2b40ae8d98208d64a7f20d Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-TestVolumeBootPattern-1537325088-project Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 898652a4-3e08-45f7-a331-888e7dec6188 could not be found. Oct 27 09:50:17.587599 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '898652a4-3e08-45f7-a331-888e7dec6188'} Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 898652a4-3e08-45f7-a331-888e7dec6188 could not be found. Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:50:17.588698 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 898652a4-3e08-45f7-a331-888e7dec6188 could not be found. Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 898652a4-3e08-45f7-a331-888e7dec6188 could not be found. Oct 27 09:50:17.590369 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:17.591875 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Returning 404 to user: Instance 898652a4-3e08-45f7-a331-888e7dec6188 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:50:17.591875 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-81cad63f-ea07-4332-93e4-9604f6212230 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188" status: 404 len: 111 microversion: 2.1 time: 0.032083 Oct 27 09:50:17.591875 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 604/1196] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:17 2022] GET /compute/v2.1/servers/898652a4-3e08-45f7-a331-888e7dec6188 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:50:20.856842 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-2a86d9c4-0d49-40de-8509-25665a374e0b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:20.857321 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2a86d9c4-0d49-40de-8509-25665a374e0b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:20.859380 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-5f3688af-7d77-4b1e-9114-2798eb9c601f req-5bfa7a08-3698-4b2b-91cc-8b1b6455f4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be390996-dc4a-4a16-999e-2f9e829870ef", "tag": "e8788048-f682-4e10-853b-7d55b6d2595c"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:20.863980 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a86d9c4-0d49-40de-8509-25665a374e0b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:20.864715 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a86d9c4-0d49-40de-8509-25665a374e0b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:20.865375 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a86d9c4-0d49-40de-8509-25665a374e0b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:20.866270 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a86d9c4-0d49-40de-8509-25665a374e0b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:20.867158 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a86d9c4-0d49-40de-8509-25665a374e0b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:20.868426 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-2a86d9c4-0d49-40de-8509-25665a374e0b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:20.871097 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5f3688af-7d77-4b1e-9114-2798eb9c601f req-5bfa7a08-3698-4b2b-91cc-8b1b6455f4e6 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:20.871650 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5f3688af-7d77-4b1e-9114-2798eb9c601f req-5bfa7a08-3698-4b2b-91cc-8b1b6455f4e6 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:20.872324 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-5f3688af-7d77-4b1e-9114-2798eb9c601f req-5bfa7a08-3698-4b2b-91cc-8b1b6455f4e6 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:20.884876 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-5f3688af-7d77-4b1e-9114-2798eb9c601f req-5bfa7a08-3698-4b2b-91cc-8b1b6455f4e6 service nova] Creating event network-changed:e8788048-f682-4e10-853b-7d55b6d2595c for instance be390996-dc4a-4a16-999e-2f9e829870ef on hv-cinder-79797 Oct 27 09:50:20.889915 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-5f3688af-7d77-4b1e-9114-2798eb9c601f req-5bfa7a08-3698-4b2b-91cc-8b1b6455f4e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034252 Oct 27 09:50:20.890739 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 605/1197] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:50:20.897524 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-2a86d9c4-0d49-40de-8509-25665a374e0b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Going to try to terminate instance {{(pid=125362) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 09:50:20.982860 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-2a86d9c4-0d49-40de-8509-25665a374e0b tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "DELETE /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 204 len: 0 microversion: 2.1 time: 0.129316 Oct 27 09:50:20.984823 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 593/1198] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:50:20 2022] DELETE /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 09:50:20.993107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-d712664f-8919-4a3d-b8ea-1fd2a5714ff6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:20.993822 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-d712664f-8919-4a3d-b8ea-1fd2a5714ff6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:21.000335 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d712664f-8919-4a3d-b8ea-1fd2a5714ff6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:21.000868 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d712664f-8919-4a3d-b8ea-1fd2a5714ff6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:21.001308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d712664f-8919-4a3d-b8ea-1fd2a5714ff6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:21.002017 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d712664f-8919-4a3d-b8ea-1fd2a5714ff6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:21.002475 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d712664f-8919-4a3d-b8ea-1fd2a5714ff6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:21.002899 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-d712664f-8919-4a3d-b8ea-1fd2a5714ff6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:21.166807 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.policy [None req-d712664f-8919-4a3d-b8ea-1fd2a5714ff6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125361) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:21.174974 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-d712664f-8919-4a3d-b8ea-1fd2a5714ff6 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1575 microversion: 2.1 time: 0.186733 Oct 27 09:50:21.175542 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 606/1199] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:20 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 09:50:22.199888 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-6dabe908-44a9-4102-bcac-1efaca6f8428 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:22.200912 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-6dabe908-44a9-4102-bcac-1efaca6f8428 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:22.207177 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6dabe908-44a9-4102-bcac-1efaca6f8428 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:22.207662 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6dabe908-44a9-4102-bcac-1efaca6f8428 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:22.208098 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6dabe908-44a9-4102-bcac-1efaca6f8428 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:22.208849 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6dabe908-44a9-4102-bcac-1efaca6f8428 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:22.209306 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6dabe908-44a9-4102-bcac-1efaca6f8428 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:22.209732 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-6dabe908-44a9-4102-bcac-1efaca6f8428 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:22.356540 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-6dabe908-44a9-4102-bcac-1efaca6f8428 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:22.364369 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-6dabe908-44a9-4102-bcac-1efaca6f8428 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1575 microversion: 2.1 time: 0.169277 Oct 27 09:50:22.364970 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 594/1200] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:22 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:22.918175 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [req-2e264a1d-878a-48ec-b865-af519c53368e req-bfde957a-ba3b-4ff3-af5a-23ff7f0a0856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be390996-dc4a-4a16-999e-2f9e829870ef", "name": "network-vif-deleted", "tag": "e8788048-f682-4e10-853b-7d55b6d2595c"}]} {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 09:50:22.929011 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-2e264a1d-878a-48ec-b865-af519c53368e req-bfde957a-ba3b-4ff3-af5a-23ff7f0a0856 service nova] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:22.929367 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-2e264a1d-878a-48ec-b865-af519c53368e req-bfde957a-ba3b-4ff3-af5a-23ff7f0a0856 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:22.930028 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [req-2e264a1d-878a-48ec-b865-af519c53368e req-bfde957a-ba3b-4ff3-af5a-23ff7f0a0856 service nova] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:22.942160 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.compute.server_external_events [req-2e264a1d-878a-48ec-b865-af519c53368e req-bfde957a-ba3b-4ff3-af5a-23ff7f0a0856 service nova] Creating event network-vif-deleted:e8788048-f682-4e10-853b-7d55b6d2595c for instance be390996-dc4a-4a16-999e-2f9e829870ef on hv-cinder-79797 Oct 27 09:50:22.947322 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [req-2e264a1d-878a-48ec-b865-af519c53368e req-bfde957a-ba3b-4ff3-af5a-23ff7f0a0856 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032850 Oct 27 09:50:22.947932 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 607/1201] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Oct 27 09:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 09:50:23.387848 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:23.388468 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:23.395014 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:23.395516 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:23.395933 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:23.396662 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:23.397117 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:23.397543 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:23.427685 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:23.428161 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:23.428629 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:23.429071 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.objects.instance [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lazy-loading 'fault' on Instance uuid be390996-dc4a-4a16-999e-2f9e829870ef {{(pid=125362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 09:50:23.470323 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.policy [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127c4fdd8f2b40ae8d98208d64a7f20d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ee2066bcc7240f9a63d5c11a2b04a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125362) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 09:50:23.478451 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-d68edfad-68b6-415a-813b-332a04b0bb3f tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 200 len: 1230 microversion: 2.1 time: 0.094424 Oct 27 09:50:23.479025 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 595/1202] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:23 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 09:50:24.503826 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:24.504916 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: be390996-dc4a-4a16-999e-2f9e829870ef] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:24.511555 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:24.512044 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:24.512481 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:24.513210 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:24.513664 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:24.514092 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:24.528909 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] HTTP exception thrown: Instance be390996-dc4a-4a16-999e-2f9e829870ef could not be found. Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Request method failure captured: Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef HTTP/1.1 Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlLQIp-ucUOf18oo9M5d7kRoEr-ZZ7Dh-IfRCy33ywIFbyJdos7fpZ9sgU09ewHULz_GCyG2u7-BVSJPJNSWhF3XJ183FRJHoyZuy3XJqh3_edP210aFU826H1tpcn2se-7BjdhSXPatXdYsYaguEVR8klv8BjlCCUrsEchQ2U0F8kg Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 4ee2066bcc7240f9a63d5c11a2b04a18 Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:50:24.530576 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 4ee2066bcc7240f9a63d5c11a2b04a18 Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-TestVolumeBootPattern-1537325088-project Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 127c4fdd8f2b40ae8d98208d64a7f20d Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-TestVolumeBootPattern-1537325088-project Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance be390996-dc4a-4a16-999e-2f9e829870ef could not be found. Oct 27 09:50:24.532308 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': 'be390996-dc4a-4a16-999e-2f9e829870ef'} Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be390996-dc4a-4a16-999e-2f9e829870ef could not be found. Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:50:24.533526 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be390996-dc4a-4a16-999e-2f9e829870ef could not be found. Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be390996-dc4a-4a16-999e-2f9e829870ef could not be found. Oct 27 09:50:24.535107 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:24.536646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Returning 404 to user: Instance be390996-dc4a-4a16-999e-2f9e829870ef could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:50:24.536646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f6b4aeea-cb32-4c02-8585-7498476e7fea tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef" status: 404 len: 111 microversion: 2.1 time: 0.033075 Oct 27 09:50:24.536646 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 608/1203] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:24 2022] GET /compute/v2.1/servers/be390996-dc4a-4a16-999e-2f9e829870ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:50:24.975627 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:24.976147 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.compute.api [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125362) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:24.982669 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:24.983149 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:24.983584 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:24.984272 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:24.984760 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:24.985184 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG oslo_concurrency.lockutils [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:25.000773 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.wsgi [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] HTTP exception thrown: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Request method failure captured: Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: request: DELETE /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 HTTP/1.1 Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept: application/json Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Accept-Encoding: identity Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Connection: close Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Length: 0 Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Content-Type: application/json Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Host: 10.222.0.70 Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: Openstack-System-Scope: None Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: User-Agent: python-urllib3/1.26.12 Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Auth-Token: gAAAAABjWlLQIp-ucUOf18oo9M5d7kRoEr-ZZ7Dh-IfRCy33ywIFbyJdos7fpZ9sgU09ewHULz_GCyG2u7-BVSJPJNSWhF3XJ183FRJHoyZuy3XJqh3_edP210aFU826H1tpcn2se-7BjdhSXPatXdYsYaguEVR8klv8BjlCCUrsEchQ2U0F8kg Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Id: None Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Domain-Name: None Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Identity-Status: Confirmed Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Is-Admin-Project: True Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Id: default Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Domain-Name: Default Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Id: 4ee2066bcc7240f9a63d5c11a2b04a18 Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Project-Name: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Role: member,reader Oct 27 09:50:25.002406 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Roles: member,reader Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Id: 4ee2066bcc7240f9a63d5c11a2b04a18 Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-Tenant-Name: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User: tempest-TestVolumeBootPattern-1537325088-project Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Id: default Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Domain-Name: Default Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Id: 127c4fdd8f2b40ae8d98208d64a7f20d Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: X-User-Name: tempest-TestVolumeBootPattern-1537325088-project Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: method: > Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: exception: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:50:25.004048 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: action_args: {'id': '4b99fff6-5d91-4648-8384-6a57c8ee57b4'} Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:50:25.005000 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:50:25.006357 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: ERROR nova.api.openstack.wsgi Oct 27 09:50:25.007798 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Returning 404 to user: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. {{(pid=125362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:50:25.007798 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-935f180a-84b7-453a-b654-44c2f1464909 tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 404 len: 111 microversion: 2.1 time: 0.032154 Oct 27 09:50:25.007798 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 596/1204] 10.222.0.70 () {58 vars in 1239 bytes} [Thu Oct 27 09:50:24 2022] DELETE /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:50:25.013366 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '>' {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:25.014004 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.compute.api [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] [instance: 4b99fff6-5d91-4648-8384-6a57c8ee57b4] Fetching instance by UUID {{(pid=125361) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 09:50:25.019842 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:25.020345 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:25.020827 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:25.021517 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Acquiring lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 09:50:25.021972 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 09:50:25.022399 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG oslo_concurrency.lockutils [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Lock "fbb9bbb7-d276-4c35-b3e7-86f2907dac7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 09:50:25.038098 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.wsgi [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] HTTP exception thrown: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Request method failure captured: Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: request: GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 HTTP/1.1 Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept: application/json Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Accept-Encoding: identity Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Connection: close Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Length: 0 Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Content-Type: application/json Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Host: 10.222.0.70 Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: Openstack-System-Scope: None Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: User-Agent: python-urllib3/1.26.12 Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Auth-Token: gAAAAABjWlLQIp-ucUOf18oo9M5d7kRoEr-ZZ7Dh-IfRCy33ywIFbyJdos7fpZ9sgU09ewHULz_GCyG2u7-BVSJPJNSWhF3XJ183FRJHoyZuy3XJqh3_edP210aFU826H1tpcn2se-7BjdhSXPatXdYsYaguEVR8klv8BjlCCUrsEchQ2U0F8kg Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Id: None Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Domain-Name: None Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Identity-Status: Confirmed Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Is-Admin-Project: True Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Id: default Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Domain-Name: Default Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Id: 4ee2066bcc7240f9a63d5c11a2b04a18 Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Project-Name: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Role: member,reader Oct 27 09:50:25.039925 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Roles: member,reader Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4ee2066bcc7240f9a63d5c11a2b04a18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Id: 4ee2066bcc7240f9a63d5c11a2b04a18 Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-Tenant-Name: tempest-TestVolumeBootPattern-1537325088 Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User: tempest-TestVolumeBootPattern-1537325088-project Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Id: default Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Domain-Name: Default Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Id: 127c4fdd8f2b40ae8d98208d64a7f20d Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: X-User-Name: tempest-TestVolumeBootPattern-1537325088-project Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: method: > Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: exception: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:50:25.041623 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: action_args: {'id': '4b99fff6-5d91-4648-8384-6a57c8ee57b4'} Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: {{(pid=125361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 09:50:25.042575 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. Oct 27 09:50:25.044164 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: ERROR nova.api.openstack.wsgi Oct 27 09:50:25.045630 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: DEBUG nova.api.openstack.wsgi [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Returning 404 to user: Instance 4b99fff6-5d91-4648-8384-6a57c8ee57b4 could not be found. {{(pid=125361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 09:50:25.045630 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: INFO nova.api.openstack.requestlog [None req-f69ea95a-6c38-4a2b-93a1-21d9fe8b99bf tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4" status: 404 len: 111 microversion: 2.1 time: 0.031815 Oct 27 09:50:25.045630 dv-cinder-797970-7-iscsi devstack@n-api.service[125361]: [pid: 125361|app: 0|req: 609/1205] 10.222.0.70 () {58 vars in 1236 bytes} [Thu Oct 27 09:50:25 2022] GET /compute/v2.1/servers/4b99fff6-5d91-4648-8384-6a57c8ee57b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 09:50:26.336358 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: DEBUG nova.api.openstack.wsgi [None req-b3296f05-72c1-4a68-8015-4a0af7c31a4c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] Calling method '.version_select at 0x7f364cc16280>' {{(pid=125362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 09:50:26.359481 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: INFO nova.api.openstack.requestlog [None req-b3296f05-72c1-4a68-8015-4a0af7c31a4c tempest-TestVolumeBootPattern-1537325088 tempest-TestVolumeBootPattern-1537325088-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1203524332" status: 202 len: 0 microversion: 2.1 time: 0.027075 Oct 27 09:50:26.360433 dv-cinder-797970-7-iscsi devstack@n-api.service[125362]: [pid: 125362|app: 0|req: 597/1206] 10.222.0.70 () {58 vars in 1263 bytes} [Thu Oct 27 09:50:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1203524332 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)